[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:40 dist-test-slave-gjw7 krb5kdc[6038](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:40 dist-test-slave-gjw7 krb5kdc[6038](info): set up 2 sockets
Aug 11 18:57:40 dist-test-slave-gjw7 krb5kdc[6038](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 18:57:42.258107 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.461s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:57:42 dist-test-slave-gjw7 krb5kdc[6038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 18:57:42.379678 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:45605
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:43351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:45605
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:42.464723 6064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:42.464942 6064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:42.464973 6064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:42.466169 6064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:42.466213 6064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:42.466233 6064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:42.466246 6064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:42.466262 6064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:42.467959 6064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:43351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:45605
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:45605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:42.468370 6064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:42.468636 6064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:42.476116 6077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:42.476178 6076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:42.476481 6080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:42.476464 6064 server_base.cc:1034] running on GCE node
I20260811 18:57:42.476854 6064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:42.477319 6064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:42.478462 6064 hybrid_clock.cc:648] HybridClock initialized: now 1786474662478441 us; error 81 us; skew 500 ppm
Aug 11 18:57:42 dist-test-slave-gjw7 krb5kdc[6038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474662, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:42.483507 6064 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 18:57:42.484174 6064 webserver.cc:460] Webserver started at http://127.5.226.126:44315/ using document root <none> and password file <none>
I20260811 18:57:42.484377 6064 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:42.484422 6064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:42.484519 6064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:42.485661 6064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "44d7211699004b9fb9c6b95426aae034"
format_stamp: "Formatted at 2026-08-11 18:57:42 on dist-test-slave-gjw7"
server_key: "d2173c2e9d6b47881a5f93efb5e053cb"
server_key_iv: "a653e311da39b8c52e3715dc898f9992"
server_key_version: "encryptionkey@0"
I20260811 18:57:42.485989 6064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "44d7211699004b9fb9c6b95426aae034"
format_stamp: "Formatted at 2026-08-11 18:57:42 on dist-test-slave-gjw7"
server_key: "d2173c2e9d6b47881a5f93efb5e053cb"
server_key_iv: "a653e311da39b8c52e3715dc898f9992"
server_key_version: "encryptionkey@0"
I20260811 18:57:42.487479 6064 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:57:42.488173 6088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:42.488373 6064 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:42.488482 6064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "44d7211699004b9fb9c6b95426aae034"
format_stamp: "Formatted at 2026-08-11 18:57:42 on dist-test-slave-gjw7"
server_key: "d2173c2e9d6b47881a5f93efb5e053cb"
server_key_iv: "a653e311da39b8c52e3715dc898f9992"
server_key_version: "encryptionkey@0"
I20260811 18:57:42.488556 6064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:42.506669 6064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:42.508965 6064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:42.509155 6064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:42.514312 6064 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:45605
I20260811 18:57:42.514398 6183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:45605 every 8 connection(s)
I20260811 18:57:42.514968 6064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:42.516500 6184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:42.519806 6184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034: Bootstrap starting.
I20260811 18:57:42.520828 6184 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:42.521268 6184 log.cc:824] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:42.522109 6184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034: No bootstrap required, opened a new log
I20260811 18:57:42.524003 6184 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44d7211699004b9fb9c6b95426aae034" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45605 } }
I20260811 18:57:42.524181 6184 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:42.524286 6184 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44d7211699004b9fb9c6b95426aae034, State: Initialized, Role: FOLLOWER
I20260811 18:57:42.524561 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 6064
I20260811 18:57:42.524498 6184 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44d7211699004b9fb9c6b95426aae034" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45605 } }
I20260811 18:57:42.524645 6184 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:42.524652 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:57:42.524701 6184 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:42.524770 6184 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:42.525365 6025 external_mini_cluster.cc:1428] Setting key f83d1604b7416da23075b9c59fca79e1
I20260811 18:57:42.525514 6184 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44d7211699004b9fb9c6b95426aae034" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45605 } }
I20260811 18:57:42.525770 6184 leader_election.cc:302] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44d7211699004b9fb9c6b95426aae034; no voters:
I20260811 18:57:42.526017 6184 leader_election.cc:288] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:42.526057 6191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:42.526266 6191 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [term 1 LEADER]: Becoming Leader. State: Replica: 44d7211699004b9fb9c6b95426aae034, State: Running, Role: LEADER
I20260811 18:57:42.526423 6191 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44d7211699004b9fb9c6b95426aae034" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45605 } }
I20260811 18:57:42.526940 6192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44d7211699004b9fb9c6b95426aae034. Latest consensus state: current_term: 1 leader_uuid: "44d7211699004b9fb9c6b95426aae034" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44d7211699004b9fb9c6b95426aae034" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45605 } } }
I20260811 18:57:42.527014 6192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:42.527246 6194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44d7211699004b9fb9c6b95426aae034" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44d7211699004b9fb9c6b95426aae034" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45605 } } }
I20260811 18:57:42.527295 6194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:42.527734 6184 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:42.527952 6199 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:42.529081 6199 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:42.531674 6199 catalog_manager.cc:1347] Generated new cluster ID: b503be464378403f935194caaf05334b
I20260811 18:57:42.531733 6199 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:57:42 dist-test-slave-gjw7 krb5kdc[6038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:42.541607 6217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:42.528806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51444 (local address 127.5.226.126:45605)
0811 18:57:42.529047 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:42.529058 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:42.529119 (+ 61us) server_negotiation.cc:407] Connection header received
0811 18:57:42.530288 (+ 1169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:42.530295 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:42.530414 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:42.530540 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:42.532431 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:42.533385 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:42.534342 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:42.534735 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:42.534827 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:42.538154 (+ 3327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:42.538158 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:42.538159 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:42.538170 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:42.539698 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:42.540068 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:42.540070 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:42.540071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:42.540159 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:42.540382 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:42.540383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:42.540384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:42.540600 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:42.540764 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:42.541001 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 18:57:42.541171 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":142,"thread_start_us":84,"threads_started":1}
I20260811 18:57:42.547158 6199 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:42.547647 6199 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:42.555615 6199 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44d7211699004b9fb9c6b95426aae034: Generated new TSK 0
I20260811 18:57:42.555766 6199 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 18:57:42.581692 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:45605
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:43351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:42.703959 6239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:42.704264 6239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:42.704319 6239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:42.706040 6239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:42.706099 6239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:42.706141 6239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:57:42.708266 6239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:43351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:45605
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:42.708592 6239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:42.708880 6239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:42.714448 6247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:42.714496 6245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:42.714454 6250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:42.714648 6239 server_base.cc:1034] running on GCE node
I20260811 18:57:42.714895 6239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:42.715127 6239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:42.716264 6239 hybrid_clock.cc:648] HybridClock initialized: now 1786474662716250 us; error 31 us; skew 500 ppm
Aug 11 18:57:42 dist-test-slave-gjw7 krb5kdc[6038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474662, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:42.718691 6239 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 18:57:42.719079 6239 webserver.cc:460] Webserver started at http://127.5.226.65:37417/ using document root <none> and password file <none>
I20260811 18:57:42.719269 6239 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:42.719313 6239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:42.719432 6239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:42.720404 6239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "9a4b05a4e1f347538f0f5d1939031e98"
format_stamp: "Formatted at 2026-08-11 18:57:42 on dist-test-slave-gjw7"
server_key: "4172b4e19173673475ef9ffa708ee2bf"
server_key_iv: "bda4791cbd124b136c98c69b4ec638ad"
server_key_version: "encryptionkey@0"
I20260811 18:57:42.720750 6239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "9a4b05a4e1f347538f0f5d1939031e98"
format_stamp: "Formatted at 2026-08-11 18:57:42 on dist-test-slave-gjw7"
server_key: "4172b4e19173673475ef9ffa708ee2bf"
server_key_iv: "bda4791cbd124b136c98c69b4ec638ad"
server_key_version: "encryptionkey@0"
I20260811 18:57:42.722105 6239 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:42.722844 6261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:42.723001 6239 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:42.723084 6239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "9a4b05a4e1f347538f0f5d1939031e98"
format_stamp: "Formatted at 2026-08-11 18:57:42 on dist-test-slave-gjw7"
server_key: "4172b4e19173673475ef9ffa708ee2bf"
server_key_iv: "bda4791cbd124b136c98c69b4ec638ad"
server_key_version: "encryptionkey@0"
I20260811 18:57:42.723143 6239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:42.735584 6239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:42.737696 6239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:42.737823 6239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:42.738080 6239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:42.738443 6239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:42.738525 6239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:42.738560 6239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:42.738584 6239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:42.744627 6239 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:39787
I20260811 18:57:42.744686 6445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:39787 every 8 connection(s)
I20260811 18:57:42.744972 6239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 18:57:42.747591 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 6239
I20260811 18:57:42.747692 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:57:42.747843 6025 external_mini_cluster.cc:1428] Setting key 6b589ecbbb594d1e5fc5b5d05aa4c895
Aug 11 18:57:42 dist-test-slave-gjw7 krb5kdc[6038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474662, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:42.755177 6217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:42.745968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:36601 (local address 127.5.226.126:45605)
0811 18:57:42.746008 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:42.746010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:42.746271 (+ 261us) server_negotiation.cc:407] Connection header received
0811 18:57:42.746766 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:42.746767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:42.746783 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:42.746833 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:42.748249 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:42.748902 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:42.749941 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:42.750135 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:42.750192 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:42.752410 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:42.752411 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:42.752412 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:42.752418 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:42.753767 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:42.754156 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:42.754158 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:42.754158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:42.754256 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:42.754537 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:42.754538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:42.754539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:42.754689 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:42.754763 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:42.754994 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 18:57:42.755081 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 18:57:42.755232 6449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:42.745967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:45605 (local address 127.5.226.65:36601)
0811 18:57:42.746122 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:42.746158 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:42.746670 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:42.746905 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:42.746908 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:42.747846 (+ 938us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:42.748132 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:42.748141 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:42.748992 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:42.748993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:42.749860 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:42.749863 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:42.750211 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:42.750212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:42.750326 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:42.750747 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:42.750755 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:42.752298 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:42.753844 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:42.753853 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:42.753856 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:42.754072 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:42.754349 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:42.754351 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:42.754351 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:42.754463 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:42.754753 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:42.754756 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:42.754871 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 18:57:42.754951 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 18:57:42.755074 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
I20260811 18:57:42.755784 6446 heartbeater.cc:347] Connected to a master server at 127.5.226.126:45605
I20260811 18:57:42.755880 6446 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:42.756058 6446 heartbeater.cc:511] Master 127.5.226.126:45605 requested a full tablet report, sending...
I20260811 18:57:42.757088 6119 ts_manager.cc:194] Registered new tserver with Master: 9a4b05a4e1f347538f0f5d1939031e98 (127.5.226.65:39787)
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
I20260811 18:57:42.758258 6119 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:36601
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 18:57:42.775415 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:45605
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:43351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:42.857378 6453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:42.857565 6453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:42.857587 6453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:42.858655 6453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:42.858688 6453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:42.858713 6453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:57:42.860101 6453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:43351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:45605
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:42.860296 6453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:42.860476 6453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:42.865091 6458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:42.865127 6459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:42.865129 6462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:42.865165 6453 server_base.cc:1034] running on GCE node
I20260811 18:57:42.865515 6453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:42.865731 6453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:42.866861 6453 hybrid_clock.cc:648] HybridClock initialized: now 1786474662866852 us; error 31 us; skew 500 ppm
Aug 11 18:57:42 dist-test-slave-gjw7 krb5kdc[6038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474662, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:42.869254 6453 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 18:57:42.869663 6453 webserver.cc:460] Webserver started at http://127.5.226.66:44663/ using document root <none> and password file <none>
I20260811 18:57:42.869858 6453 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:42.869897 6453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:42.870020 6453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:42.870988 6453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "6a11e0f8987f4d5a8d233fb061b18576"
format_stamp: "Formatted at 2026-08-11 18:57:42 on dist-test-slave-gjw7"
server_key: "344069ab374c91fe9c6ee17f30e8b9a9"
server_key_iv: "fb9cac6751b99965b484fa9e756e448a"
server_key_version: "encryptionkey@0"
I20260811 18:57:42.871266 6453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "6a11e0f8987f4d5a8d233fb061b18576"
format_stamp: "Formatted at 2026-08-11 18:57:42 on dist-test-slave-gjw7"
server_key: "344069ab374c91fe9c6ee17f30e8b9a9"
server_key_iv: "fb9cac6751b99965b484fa9e756e448a"
server_key_version: "encryptionkey@0"
I20260811 18:57:42.872466 6453 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:42.873127 6470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:42.873267 6453 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:42.873383 6453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "6a11e0f8987f4d5a8d233fb061b18576"
format_stamp: "Formatted at 2026-08-11 18:57:42 on dist-test-slave-gjw7"
server_key: "344069ab374c91fe9c6ee17f30e8b9a9"
server_key_iv: "fb9cac6751b99965b484fa9e756e448a"
server_key_version: "encryptionkey@0"
I20260811 18:57:42.873450 6453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:42.894411 6453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:42.896384 6453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:42.896535 6453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:42.896760 6453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:42.897078 6453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:42.897112 6453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:42.897141 6453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:42.897164 6453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:42.902829 6453 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:39823
I20260811 18:57:42.902881 6687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:39823 every 8 connection(s)
I20260811 18:57:42.903164 6453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
Aug 11 18:57:42 dist-test-slave-gjw7 krb5kdc[6038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474662, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:42.910559 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 6453
I20260811 18:57:42.910656 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:57:42.910832 6025 external_mini_cluster.cc:1428] Setting key 1e6a43811d66bbd4b644cb551ac29383
I20260811 18:57:42.911660 6217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:42.903907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:37591 (local address 127.5.226.126:45605)
0811 18:57:42.903950 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:42.903952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:42.904151 (+ 199us) server_negotiation.cc:407] Connection header received
0811 18:57:42.904648 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:42.904649 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:42.904661 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:42.904726 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:42.905641 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:42.906136 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:42.907038 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:42.907230 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:42.907279 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:42.909131 (+ 1852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:42.909132 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:42.909133 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:42.909139 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:42.910248 (+ 1109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:42.910681 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:42.910682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:42.910682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:42.910754 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:42.911028 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:42.911029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:42.911030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:42.911174 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:42.911237 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:42.911478 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 18:57:42.911571 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 18:57:42.911790 6693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:42.903886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:45605 (local address 127.5.226.66:37591)
0811 18:57:42.904029 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:42.904065 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:42.904539 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:42.904788 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:42.904791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:42.905369 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:42.905568 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:42.905573 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:42.906198 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:42.906199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:42.906971 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:42.906973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:42.907287 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:42.907288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:42.907386 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:42.907758 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:42.907766 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:42.909050 (+ 1284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:42.910315 (+ 1265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:42.910321 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:42.910323 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:42.910593 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:42.910815 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:42.910816 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:42.910817 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:42.910957 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:42.911227 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:42.911235 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:42.911357 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 18:57:42.911457 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 18:57:42.911603 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":79,"threads_started":1}
I20260811 18:57:42.912271 6691 heartbeater.cc:347] Connected to a master server at 127.5.226.126:45605
I20260811 18:57:42.912375 6691 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:42.912554 6691 heartbeater.cc:511] Master 127.5.226.126:45605 requested a full tablet report, sending...
I20260811 18:57:42.912909 6119 ts_manager.cc:194] Registered new tserver with Master: 6a11e0f8987f4d5a8d233fb061b18576 (127.5.226.66:39823)
I20260811 18:57:42.913269 6119 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:37591
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 18:57:42.935523 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:45605
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:43351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:43.017979 6698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:43.018173 6698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:43.018195 6698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:43.019275 6698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:43.019308 6698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:43.019333 6698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:57:43.020756 6698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:43351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:45605
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:43.020938 6698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:43.021112 6698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:43.025892 6711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:43.025969 6698 server_base.cc:1034] running on GCE node
W20260811 18:57:43.025868 6714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:43.025933 6707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:43.026250 6698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:43.026463 6698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:43.027604 6698 hybrid_clock.cc:648] HybridClock initialized: now 1786474663027592 us; error 28 us; skew 500 ppm
Aug 11 18:57:43 dist-test-slave-gjw7 krb5kdc[6038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474663, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:43.030128 6698 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 18:57:43.030555 6698 webserver.cc:460] Webserver started at http://127.5.226.67:32789/ using document root <none> and password file <none>
I20260811 18:57:43.030728 6698 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:43.030767 6698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:43.030855 6698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:43.031852 6698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "2dbca2f23fe343dbb09d57b280f42d1b"
format_stamp: "Formatted at 2026-08-11 18:57:43 on dist-test-slave-gjw7"
server_key: "ea189c00d8ac620e8d179e351793e400"
server_key_iv: "01e12b8deaa4f97e79710eeaf1eba22a"
server_key_version: "encryptionkey@0"
I20260811 18:57:43.032140 6698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "2dbca2f23fe343dbb09d57b280f42d1b"
format_stamp: "Formatted at 2026-08-11 18:57:43 on dist-test-slave-gjw7"
server_key: "ea189c00d8ac620e8d179e351793e400"
server_key_iv: "01e12b8deaa4f97e79710eeaf1eba22a"
server_key_version: "encryptionkey@0"
I20260811 18:57:43.033317 6698 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:43.033988 6725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:43.034130 6698 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:43.034215 6698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "2dbca2f23fe343dbb09d57b280f42d1b"
format_stamp: "Formatted at 2026-08-11 18:57:43 on dist-test-slave-gjw7"
server_key: "ea189c00d8ac620e8d179e351793e400"
server_key_iv: "01e12b8deaa4f97e79710eeaf1eba22a"
server_key_version: "encryptionkey@0"
I20260811 18:57:43.034271 6698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:43.054662 6698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:43.056807 6698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:43.056918 6698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:43.057116 6698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:43.057421 6698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:43.057457 6698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:43.057479 6698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:43.057498 6698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:43.063340 6698 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:38083
I20260811 18:57:43.063409 6950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:38083 every 8 connection(s)
I20260811 18:57:43.063684 6698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
Aug 11 18:57:43 dist-test-slave-gjw7 krb5kdc[6038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474663, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:43.070832 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 6698
I20260811 18:57:43.070904 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:57:43.071033 6025 external_mini_cluster.cc:1428] Setting key c032b62af2864824a73db41f3db9ce2a
I20260811 18:57:43.072932 6217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:43.064416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:47679 (local address 127.5.226.126:45605)
0811 18:57:43.064532 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:43.064534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:43.064700 (+ 166us) server_negotiation.cc:407] Connection header received
0811 18:57:43.065162 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:43.065163 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:43.065174 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:43.065238 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:43.066228 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:43.066741 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:43.067712 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:43.067913 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:43.067980 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:43.070053 (+ 2073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:43.070055 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:43.070055 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:43.070063 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:43.071625 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:43.072025 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:43.072026 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:43.072027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:43.072087 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:43.072360 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:43.072361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:43.072362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:43.072486 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:43.072549 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:43.072793 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 18:57:43.072866 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 18:57:43.073058 6955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:43.064364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:45605 (local address 127.5.226.67:47679)
0811 18:57:43.064571 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:43.064609 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:43.065084 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:43.065353 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:43.065357 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:43.065917 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:43.066116 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:43.066122 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:43.066835 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:43.066836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:43.067623 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:43.067626 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:43.067984 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:43.067985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:43.068078 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:43.068523 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:43.068532 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:43.069953 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:43.071702 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:43.071709 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:43.071711 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:43.071957 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:43.072171 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:43.072172 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:43.072172 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:43.072284 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:43.072546 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:43.072551 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:43.072663 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 18:57:43.072745 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 18:57:43.072876 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":135,"threads_started":1}
I20260811 18:57:43.073565 6951 heartbeater.cc:347] Connected to a master server at 127.5.226.126:45605
I20260811 18:57:43.073648 6951 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:43.073787 6951 heartbeater.cc:511] Master 127.5.226.126:45605 requested a full tablet report, sending...
I20260811 18:57:43.074105 6119 ts_manager.cc:194] Registered new tserver with Master: 2dbca2f23fe343dbb09d57b280f42d1b (127.5.226.67:38083)
I20260811 18:57:43.074430 6119 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:47679
I20260811 18:57:43.083109 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:57:43 dist-test-slave-gjw7 krb5kdc[6038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474663, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:57:43 dist-test-slave-gjw7 krb5kdc[6038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474663, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.226.65@KRBTEST.COM
I20260811 18:57:43.106256 6964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:43.099127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50558 (local address 127.5.226.65:39787)
0811 18:57:43.099320 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:43.099324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:43.099336 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:57:43.099363 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:43.099365 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:43.099379 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:43.099449 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:43.099945 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:43.100702 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:43.101404 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:43.101722 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:43.101784 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:43.103710 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:43.103718 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:43.103719 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:43.103726 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:43.105286 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:43.105590 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:43.105593 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:43.105593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:43.105662 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:43.105789 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:43.105790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:43.105790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:43.105910 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:43.106009 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:43.106048 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 18:57:43.106114 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":105,"threads_started":1}
W20260811 18:57:43.106732 6311 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50558
Aug 11 18:57:43 dist-test-slave-gjw7 krb5kdc[6038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:57:43 dist-test-slave-gjw7 krb5kdc[6038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.65@KRBTEST.COM
I20260811 18:57:43.128006 6964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:43.121659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50568 (local address 127.5.226.65:39787)
0811 18:57:43.121722 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:43.121724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:43.121750 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:57:43.121812 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:43.121813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:43.121824 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:43.121876 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:43.122428 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:43.122905 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:43.123616 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:43.123834 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:43.123894 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:43.125975 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:43.125977 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:43.125977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:43.125984 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:43.127202 (+ 1218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:43.127486 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:43.127487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:43.127487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:43.127535 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:43.127662 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:43.127663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:43.127663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:43.127745 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:43.127834 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:43.127880 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 18:57:43.127942 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 18:57:43.128578 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 6239
I20260811 18:57:43.148756 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 6453
I20260811 18:57:43.199059 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 6698
I20260811 18:57:43.210655 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 6064
2026-08-11T18:57:43Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2446 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:43 dist-test-slave-gjw7 krb5kdc[6980](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:43 dist-test-slave-gjw7 krb5kdc[6980](info): set up 2 sockets
Aug 11 18:57:43 dist-test-slave-gjw7 krb5kdc[6980](info): commencing operation
krb5kdc: starting...
W20260811 18:57:44.445603 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:57:44 dist-test-slave-gjw7 krb5kdc[6980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474664, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 18:57:44.561782 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:46763
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:33071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:46763
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:44.642298 7009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:44.642486 7009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:44.642506 7009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:44.643597 7009 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:44.643632 7009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:44.643646 7009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:44.643656 7009 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:44.643666 7009 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:44.645047 7009 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:33071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:46763
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:46763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:44.645233 7009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:44.645453 7009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:44.650020 7025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:44.650008 7022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:44.650194 7009 server_base.cc:1034] running on GCE node
W20260811 18:57:44.650010 7020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:44.650509 7009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:44.650795 7009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:44.651938 7009 hybrid_clock.cc:648] HybridClock initialized: now 1786474664651920 us; error 28 us; skew 500 ppm
Aug 11 18:57:44 dist-test-slave-gjw7 krb5kdc[6980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474664, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:44.654372 7009 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 18:57:44.654805 7009 webserver.cc:460] Webserver started at http://127.5.226.126:37549/ using document root <none> and password file <none>
I20260811 18:57:44.655001 7009 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:44.655049 7009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:44.655174 7009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:44.656255 7009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "a4d8cc44e87d489d8d421404f509df68"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-gjw7"
server_key: "fb9cfc7a39fde8279f45f40618b15032"
server_key_iv: "99e104e34830eb25927489c157ea2489"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.656683 7009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "a4d8cc44e87d489d8d421404f509df68"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-gjw7"
server_key: "fb9cfc7a39fde8279f45f40618b15032"
server_key_iv: "99e104e34830eb25927489c157ea2489"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.659310 7009 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 18:57:44.659966 7042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:44.660107 7009 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:44.660188 7009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "a4d8cc44e87d489d8d421404f509df68"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-gjw7"
server_key: "fb9cfc7a39fde8279f45f40618b15032"
server_key_iv: "99e104e34830eb25927489c157ea2489"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.660256 7009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:44.672039 7009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:44.673853 7009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:44.673980 7009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:44.677897 7009 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:46763
I20260811 18:57:44.677950 7135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:46763 every 8 connection(s)
I20260811 18:57:44.678272 7009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:44.679095 7136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:44.681449 7136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68: Bootstrap starting.
I20260811 18:57:44.682021 7136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:44.682294 7136 log.cc:824] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:44.682934 7136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68: No bootstrap required, opened a new log
I20260811 18:57:44.684561 7136 raft_consensus.cc:348] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4d8cc44e87d489d8d421404f509df68" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46763 } }
I20260811 18:57:44.684700 7136 raft_consensus.cc:374] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:44.684736 7136 raft_consensus.cc:729] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d8cc44e87d489d8d421404f509df68, State: Initialized, Role: FOLLOWER
I20260811 18:57:44.684878 7136 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4d8cc44e87d489d8d421404f509df68" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46763 } }
I20260811 18:57:44.684942 7136 raft_consensus.cc:388] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:44.684962 7136 raft_consensus.cc:482] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:44.685005 7136 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:44.685554 7136 raft_consensus.cc:504] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4d8cc44e87d489d8d421404f509df68" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46763 } }
I20260811 18:57:44.685649 7136 leader_election.cc:302] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a4d8cc44e87d489d8d421404f509df68; no voters:
I20260811 18:57:44.685811 7136 leader_election.cc:288] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:44.685851 7142 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:44.686009 7142 raft_consensus.cc:686] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [term 1 LEADER]: Becoming Leader. State: Replica: a4d8cc44e87d489d8d421404f509df68, State: Running, Role: LEADER
I20260811 18:57:44.686060 7136 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:44.686115 7142 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4d8cc44e87d489d8d421404f509df68" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46763 } }
I20260811 18:57:44.686506 7149 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4d8cc44e87d489d8d421404f509df68. Latest consensus state: current_term: 1 leader_uuid: "a4d8cc44e87d489d8d421404f509df68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4d8cc44e87d489d8d421404f509df68" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46763 } } }
I20260811 18:57:44.686592 7149 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:44.686743 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 7009
I20260811 18:57:44.686721 7143 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a4d8cc44e87d489d8d421404f509df68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4d8cc44e87d489d8d421404f509df68" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46763 } } }
I20260811 18:57:44.686794 7143 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:44.686825 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:57:44.686810 7158 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:44.686956 6025 external_mini_cluster.cc:1428] Setting key d1b6d65013d7c20db56fde2c329b7a18
I20260811 18:57:44.687299 7158 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:44.688923 7158 catalog_manager.cc:1347] Generated new cluster ID: 5afb6c195033406b9c98ef0d2cd77a38
I20260811 18:57:44.689006 7158 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:57:44 dist-test-slave-gjw7 krb5kdc[6980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474664, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:44.696671 7165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:44.687526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55220 (local address 127.5.226.126:46763)
0811 18:57:44.687909 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:44.687919 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:44.687965 (+ 46us) server_negotiation.cc:407] Connection header received
0811 18:57:44.688093 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:44.688101 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:44.688166 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:44.688306 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:44.689328 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:44.690271 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:44.690995 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:44.691405 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:44.691498 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:44.693680 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:44.693684 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:44.693684 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:44.693697 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:44.695218 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:44.695537 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:44.695540 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:44.695541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:44.695637 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:44.695816 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:44.695817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:44.695817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:44.696071 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:44.696232 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:44.696337 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 18:57:44.696476 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":60,"threads_started":1}
I20260811 18:57:44.699349 7158 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:44.699947 7158 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:44.712237 7158 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a4d8cc44e87d489d8d421404f509df68: Generated new TSK 0
I20260811 18:57:44.712410 7158 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 18:57:44.737965 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46763
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:33071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:44.818442 7198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:44.818643 7198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:44.818675 7198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:44.819795 7198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:44.819834 7198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:44.819869 7198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:57:44.821393 7198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:33071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46763
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:44.821616 7198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:44.821815 7198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:44.826424 7204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:44.826472 7208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:44.826676 7198 server_base.cc:1034] running on GCE node
W20260811 18:57:44.826437 7205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:44.826908 7198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:44.827131 7198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:44.828271 7198 hybrid_clock.cc:648] HybridClock initialized: now 1786474664828257 us; error 28 us; skew 500 ppm
Aug 11 18:57:44 dist-test-slave-gjw7 krb5kdc[6980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474664, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:44.830664 7198 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 18:57:44.831110 7198 webserver.cc:460] Webserver started at http://127.5.226.65:38205/ using document root <none> and password file <none>
I20260811 18:57:44.831334 7198 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:44.831384 7198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:44.831512 7198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:44.832523 7198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "7f6abf8b42c24b81b014212faa48007b"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-gjw7"
server_key: "e8b056cad2e532f37dd139ac006d0ca4"
server_key_iv: "4e92a3c4d647771319c1668278144017"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.832851 7198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "7f6abf8b42c24b81b014212faa48007b"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-gjw7"
server_key: "e8b056cad2e532f37dd139ac006d0ca4"
server_key_iv: "4e92a3c4d647771319c1668278144017"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.834121 7198 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:57:44.834779 7221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:44.834934 7198 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:57:44.835008 7198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "7f6abf8b42c24b81b014212faa48007b"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-gjw7"
server_key: "e8b056cad2e532f37dd139ac006d0ca4"
server_key_iv: "4e92a3c4d647771319c1668278144017"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.835069 7198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:44.845270 7198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:44.846961 7198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:44.847082 7198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:44.847280 7198 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:44.847551 7198 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:44.847584 7198 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:44.847610 7198 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:44.847636 7198 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:44.853010 7198 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:40333
I20260811 18:57:44.853065 7447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:40333 every 8 connection(s)
I20260811 18:57:44.853374 7198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
Aug 11 18:57:44 dist-test-slave-gjw7 krb5kdc[6980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474664, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:44.861901 7165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:44.854032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:46637 (local address 127.5.226.126:46763)
0811 18:57:44.854094 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:44.854096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:44.854261 (+ 165us) server_negotiation.cc:407] Connection header received
0811 18:57:44.855417 (+ 1156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:44.855419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:44.855431 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:44.855480 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:44.856015 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:44.856503 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:44.857583 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:44.857793 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:44.857847 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:44.859616 (+ 1769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:44.859618 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:44.859618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:44.859626 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:44.860796 (+ 1170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:44.861133 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:44.861133 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:44.861134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:44.861177 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:44.861428 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:44.861429 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:44.861429 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:44.861529 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:44.861575 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:44.861775 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 18:57:44.861839 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 18:57:44.862066 7450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:44.853994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:46763 (local address 127.5.226.65:46637)
0811 18:57:44.854141 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:44.854179 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:44.855333 (+ 1154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:44.855533 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:44.855536 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:44.855764 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:44.855952 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:44.855956 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:44.856559 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:44.856560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:44.857506 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:44.857509 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:44.857853 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:44.857854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:44.857941 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:44.858305 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:44.858313 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:44.859535 (+ 1222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:44.860862 (+ 1327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:44.860869 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:44.860871 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:44.861078 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:44.861241 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:44.861241 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:44.861242 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:44.861372 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:44.861572 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:44.861575 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:44.861677 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 18:57:44.861759 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 18:57:44.861871 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":77,"threads_started":1}
I20260811 18:57:44.862528 7448 heartbeater.cc:347] Connected to a master server at 127.5.226.126:46763
I20260811 18:57:44.862636 7448 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:44.862694 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 7198
I20260811 18:57:44.862790 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:57:44.862843 7448 heartbeater.cc:511] Master 127.5.226.126:46763 requested a full tablet report, sending...
I20260811 18:57:44.862960 6025 external_mini_cluster.cc:1428] Setting key c29a7ce0f8cf18d957fb13862a47268e
I20260811 18:57:44.863384 7067 ts_manager.cc:194] Registered new tserver with Master: 7f6abf8b42c24b81b014212faa48007b (127.5.226.65:40333)
I20260811 18:57:44.864084 7067 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:46637
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 18:57:44.887835 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46763
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:33071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:44.968577 7454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:44.968777 7454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:44.968807 7454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:44.969947 7454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:44.969987 7454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:44.970022 7454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:57:44.971513 7454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:33071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46763
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:44.971756 7454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:44.971971 7454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:44.976698 7470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:44.976791 7454 server_base.cc:1034] running on GCE node
W20260811 18:57:44.976681 7466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:44.976681 7462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:44.977075 7454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:44.977268 7454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:44.978427 7454 hybrid_clock.cc:648] HybridClock initialized: now 1786474664978419 us; error 28 us; skew 500 ppm
Aug 11 18:57:44 dist-test-slave-gjw7 krb5kdc[6980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474664, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:44.980695 7454 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 18:57:44.981068 7454 webserver.cc:460] Webserver started at http://127.5.226.66:38311/ using document root <none> and password file <none>
I20260811 18:57:44.981242 7454 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:44.981279 7454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:44.981420 7454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:44.982406 7454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "ee49ab161bdd4f3e923e6fc1825e42a0"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-gjw7"
server_key: "99d72395442381c1e34d279e92fe2bb6"
server_key_iv: "313efdd7901ed820b1767c55fe0fe458"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.982689 7454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "ee49ab161bdd4f3e923e6fc1825e42a0"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-gjw7"
server_key: "99d72395442381c1e34d279e92fe2bb6"
server_key_iv: "313efdd7901ed820b1767c55fe0fe458"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.983870 7454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:57:44.984544 7489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:44.984701 7454 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:44.984787 7454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "ee49ab161bdd4f3e923e6fc1825e42a0"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-gjw7"
server_key: "99d72395442381c1e34d279e92fe2bb6"
server_key_iv: "313efdd7901ed820b1767c55fe0fe458"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.984850 7454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:45.005007 7454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:45.006927 7454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:45.007061 7454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:45.007279 7454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:45.007593 7454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:45.007627 7454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:45.007655 7454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:45.007673 7454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:45.013142 7454 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:38113
I20260811 18:57:45.013201 7729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:38113 every 8 connection(s)
I20260811 18:57:45.013536 7454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
Aug 11 18:57:45 dist-test-slave-gjw7 krb5kdc[6980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474664, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:45.021950 7165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.014218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:39551 (local address 127.5.226.126:46763)
0811 18:57:45.014286 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.014288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.014453 (+ 165us) server_negotiation.cc:407] Connection header received
0811 18:57:45.015395 (+ 942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.015396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.015408 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.015464 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:45.016047 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.016543 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.017483 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.017679 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.017732 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.019580 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:45.019582 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:45.019582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:45.019589 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:45.020755 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.021098 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.021098 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.021098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.021145 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.021439 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.021441 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.021441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.021561 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:45.021620 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.021817 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.021887 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 18:57:45.022083 7733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.014176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:46763 (local address 127.5.226.66:39551)
0811 18:57:45.014332 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:45.014374 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:45.015291 (+ 917us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:45.015518 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:45.015521 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:45.015758 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:45.015962 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.015966 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.016606 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.016606 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.017407 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.017410 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.017740 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.017741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.017838 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.018223 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:45.018231 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:45.019500 (+ 1269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:45.020819 (+ 1319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:45.020826 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:45.020828 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:45.021041 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:45.021226 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:45.021226 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:45.021226 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:45.021361 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:45.021619 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:45.021622 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:45.021726 (+ 104us) client_negotiation.cc:769] Sending connection context
0811 18:57:45.021798 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 18:57:45.021911 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":78,"threads_started":1}
I20260811 18:57:45.022573 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 7454
I20260811 18:57:45.022595 7731 heartbeater.cc:347] Connected to a master server at 127.5.226.126:46763
I20260811 18:57:45.022644 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:57:45.022686 7731 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:45.022805 6025 external_mini_cluster.cc:1428] Setting key b3fd09bf6e09abebc9670db4b8d4019c
I20260811 18:57:45.022867 7731 heartbeater.cc:511] Master 127.5.226.126:46763 requested a full tablet report, sending...
I20260811 18:57:45.023343 7067 ts_manager.cc:194] Registered new tserver with Master: ee49ab161bdd4f3e923e6fc1825e42a0 (127.5.226.66:38113)
I20260811 18:57:45.023708 7067 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:39551
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 18:57:45.045747 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46763
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:33071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:45.126657 7736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:45.126866 7736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:45.126888 7736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:45.128034 7736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:45.128078 7736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:45.128105 7736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:57:45.129612 7736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:33071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46763
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7736
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:45.129841 7736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:45.130081 7736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:45.134845 7760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:45.134827 7755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:45.134932 7736 server_base.cc:1034] running on GCE node
W20260811 18:57:45.134827 7757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:45.135268 7736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:45.135509 7736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:45.136649 7736 hybrid_clock.cc:648] HybridClock initialized: now 1786474665136638 us; error 29 us; skew 500 ppm
Aug 11 18:57:45 dist-test-slave-gjw7 krb5kdc[6980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474665, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:45.139128 7736 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 18:57:45.139572 7736 webserver.cc:460] Webserver started at http://127.5.226.67:34585/ using document root <none> and password file <none>
I20260811 18:57:45.139772 7736 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:45.139820 7736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:45.139948 7736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:45.140975 7736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "a22477bc47b84568a27468764caa132c"
format_stamp: "Formatted at 2026-08-11 18:57:45 on dist-test-slave-gjw7"
server_key: "504a1791119f645f199b7faec8500a76"
server_key_iv: "bd00c01c502d04e1e3f961ee791e68bf"
server_key_version: "encryptionkey@0"
I20260811 18:57:45.141358 7736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "a22477bc47b84568a27468764caa132c"
format_stamp: "Formatted at 2026-08-11 18:57:45 on dist-test-slave-gjw7"
server_key: "504a1791119f645f199b7faec8500a76"
server_key_iv: "bd00c01c502d04e1e3f961ee791e68bf"
server_key_version: "encryptionkey@0"
I20260811 18:57:45.142621 7736 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:45.143311 7771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:45.143446 7736 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:57:45.143534 7736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "a22477bc47b84568a27468764caa132c"
format_stamp: "Formatted at 2026-08-11 18:57:45 on dist-test-slave-gjw7"
server_key: "504a1791119f645f199b7faec8500a76"
server_key_iv: "bd00c01c502d04e1e3f961ee791e68bf"
server_key_version: "encryptionkey@0"
I20260811 18:57:45.143600 7736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:45.155541 7736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:45.157545 7736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:45.157697 7736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:45.157915 7736 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:45.158258 7736 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:45.158298 7736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:45.158327 7736 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:45.158344 7736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:45.163944 7736 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:33451
I20260811 18:57:45.164000 8023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:33451 every 8 connection(s)
I20260811 18:57:45.164310 7736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
Aug 11 18:57:45 dist-test-slave-gjw7 krb5kdc[6980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474665, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:45.170568 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 7736
I20260811 18:57:45.170652 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:57:45.170852 6025 external_mini_cluster.cc:1428] Setting key 7a603dbb3bb54e7533b15584e27a205c
I20260811 18:57:45.173237 7165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.164978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:36155 (local address 127.5.226.126:46763)
0811 18:57:45.165031 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.165034 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.165221 (+ 187us) server_negotiation.cc:407] Connection header received
0811 18:57:45.166187 (+ 966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.166188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.166203 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.166256 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:45.166879 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.167384 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.168377 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.168579 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.168636 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.170716 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:45.170719 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:45.170719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:45.170729 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:45.172166 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.172524 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.172525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.172525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.172575 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.172752 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.172752 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.172752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.172853 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:45.172900 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.173113 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.173172 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:57:45.173650 8026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.164946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:46763 (local address 127.5.226.67:36155)
0811 18:57:45.165087 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:45.165127 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:45.166070 (+ 943us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:45.166331 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:45.166335 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:45.166589 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:45.166784 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.166789 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.167470 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.167472 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.168284 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.168287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.168648 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.168650 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.168774 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.169208 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:45.169217 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:45.170605 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:45.172236 (+ 1631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:45.172243 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:45.172244 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:45.172467 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:45.172611 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:45.172612 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:45.172612 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:45.172712 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:45.172896 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:45.172899 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:45.173014 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 18:57:45.173095 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 18:57:45.173223 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":69,"threads_started":1}
I20260811 18:57:45.174115 8024 heartbeater.cc:347] Connected to a master server at 127.5.226.126:46763
I20260811 18:57:45.174209 8024 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:45.174399 8024 heartbeater.cc:511] Master 127.5.226.126:46763 requested a full tablet report, sending...
I20260811 18:57:45.174741 7067 ts_manager.cc:194] Registered new tserver with Master: a22477bc47b84568a27468764caa132c (127.5.226.67:33451)
I20260811 18:57:45.175104 7067 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:36155
I20260811 18:57:45.182572 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:57:45.190057 7165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.184521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55236 (local address 127.5.226.126:46763)
0811 18:57:45.184585 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.184587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.184679 (+ 92us) server_negotiation.cc:407] Connection header received
0811 18:57:45.184722 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.184722 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.184731 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.184770 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:45.185308 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.185819 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.186496 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.186727 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.186803 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.187861 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:45.187862 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:45.187863 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:45.187869 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:45.189147 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.189492 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.189493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.189493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.189539 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.189669 (+ 130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.189670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.189670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.189798 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:45.189868 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.189935 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.189990 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 18:57:45.192619 7067 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55236:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:57:45.194747 7067 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:45.201397 8039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.197436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:40333 (local address 127.0.0.1:43376)
0811 18:57:45.197609 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:45.197647 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:45.197710 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:45.197986 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:45.197989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:45.197991 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:45.198057 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.198059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.199330 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.199331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.200189 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.200192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.201053 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.201054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.201144 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.201159 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 18:57:45.201235 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 18:57:45.201321 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":22,"thread_start_us":55,"threads_started":1}
I20260811 18:57:45.201402 8041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.197615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43376 (local address 127.5.226.65:40333)
0811 18:57:45.197831 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.197834 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.197842 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:57:45.197876 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.197877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.197890 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.197967 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:45.198142 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.199216 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.200273 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.200973 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.201046 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.201100 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.201254 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.201325 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":89,"threads_started":1}
I20260811 18:57:45.201727 8035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.197479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:33451 (local address 127.0.0.1:44916)
0811 18:57:45.197992 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:45.198001 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:45.198062 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:45.198215 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:45.198216 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:45.198218 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:45.198272 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.198275 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.199298 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.199299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.200482 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.200485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.201498 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.201499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.201561 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.201565 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:45.201619 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 18:57:45.201659 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":52,"threads_started":1}
I20260811 18:57:45.201756 8040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.197564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44916 (local address 127.5.226.67:33451)
0811 18:57:45.197727 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.197732 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.198061 (+ 329us) server_negotiation.cc:407] Connection header received
0811 18:57:45.198124 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.198127 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.198141 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.198219 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:45.198331 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.199207 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.200575 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.201171 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.201242 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.201323 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.201639 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.201684 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":82,"threads_started":1}
I20260811 18:57:45.201892 8042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.197436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:38113 (local address 127.0.0.1:60684)
0811 18:57:45.198068 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:45.198078 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:45.198128 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:45.198433 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:45.198434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:45.198436 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:45.198474 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.198476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.199639 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.199640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.200689 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.200691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.201620 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.201621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.201672 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.201676 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:45.201716 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 18:57:45.201749 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":257,"thread_start_us":43,"threads_started":1}
I20260811 18:57:45.202101 8043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.197828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60684 (local address 127.5.226.66:38113)
0811 18:57:45.197983 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.197987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.198186 (+ 199us) server_negotiation.cc:407] Connection header received
0811 18:57:45.198232 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.198234 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.198250 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.198337 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:45.198542 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.199538 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.200764 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.201471 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.201536 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.201589 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.201980 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.202024 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
I20260811 18:57:45.202394 7321 tablet_service.cc:1467] Processing CreateTablet for tablet ddd4d1fad883428da117c772fdcf60d3 (DEFAULT_TABLE table=test-table [id=0091986efb90406aba782379eb46f692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:45.202461 7885 tablet_service.cc:1467] Processing CreateTablet for tablet ddd4d1fad883428da117c772fdcf60d3 (DEFAULT_TABLE table=test-table [id=0091986efb90406aba782379eb46f692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:45.202726 7321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddd4d1fad883428da117c772fdcf60d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:45.202793 7885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddd4d1fad883428da117c772fdcf60d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:45.202764 7603 tablet_service.cc:1467] Processing CreateTablet for tablet ddd4d1fad883428da117c772fdcf60d3 (DEFAULT_TABLE table=test-table [id=0091986efb90406aba782379eb46f692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:45.203060 7603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddd4d1fad883428da117c772fdcf60d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:45.205322 8045 tablet_bootstrap.cc:492] T ddd4d1fad883428da117c772fdcf60d3 P 7f6abf8b42c24b81b014212faa48007b: Bootstrap starting.
I20260811 18:57:45.206168 8048 tablet_bootstrap.cc:492] T ddd4d1fad883428da117c772fdcf60d3 P a22477bc47b84568a27468764caa132c: Bootstrap starting.
I20260811 18:57:45.206413 8045 tablet_bootstrap.cc:654] T ddd4d1fad883428da117c772fdcf60d3 P 7f6abf8b42c24b81b014212faa48007b: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:45.206727 8048 tablet_bootstrap.cc:654] T ddd4d1fad883428da117c772fdcf60d3 P a22477bc47b84568a27468764caa132c: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:45.207075 8045 log.cc:824] T ddd4d1fad883428da117c772fdcf60d3 P 7f6abf8b42c24b81b014212faa48007b: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:45.207188 8048 log.cc:824] T ddd4d1fad883428da117c772fdcf60d3 P a22477bc47b84568a27468764caa132c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:45.207386 8046 tablet_bootstrap.cc:492] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0: Bootstrap starting.
I20260811 18:57:45.207866 8048 tablet_bootstrap.cc:492] T ddd4d1fad883428da117c772fdcf60d3 P a22477bc47b84568a27468764caa132c: No bootstrap required, opened a new log
I20260811 18:57:45.207882 8046 tablet_bootstrap.cc:654] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:45.207921 8048 ts_tablet_manager.cc:1397] T ddd4d1fad883428da117c772fdcf60d3 P a22477bc47b84568a27468764caa132c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:57:45.208312 8046 log.cc:824] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:45.208726 8045 tablet_bootstrap.cc:492] T ddd4d1fad883428da117c772fdcf60d3 P 7f6abf8b42c24b81b014212faa48007b: No bootstrap required, opened a new log
I20260811 18:57:45.208783 8045 ts_tablet_manager.cc:1397] T ddd4d1fad883428da117c772fdcf60d3 P 7f6abf8b42c24b81b014212faa48007b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 18:57:45.208997 8046 tablet_bootstrap.cc:492] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0: No bootstrap required, opened a new log
I20260811 18:57:45.209064 8046 ts_tablet_manager.cc:1397] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:57:45.209663 8048 raft_consensus.cc:348] T ddd4d1fad883428da117c772fdcf60d3 P a22477bc47b84568a27468764caa132c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38113 } } peers { permanent_uuid: "7f6abf8b42c24b81b014212faa48007b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40333 } } peers { permanent_uuid: "a22477bc47b84568a27468764caa132c" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 33451 } }
I20260811 18:57:45.209844 8048 raft_consensus.cc:374] T ddd4d1fad883428da117c772fdcf60d3 P a22477bc47b84568a27468764caa132c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:45.209892 8048 raft_consensus.cc:729] T ddd4d1fad883428da117c772fdcf60d3 P a22477bc47b84568a27468764caa132c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a22477bc47b84568a27468764caa132c, State: Initialized, Role: FOLLOWER
I20260811 18:57:45.210024 8048 consensus_queue.cc:260] T ddd4d1fad883428da117c772fdcf60d3 P a22477bc47b84568a27468764caa132c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38113 } } peers { permanent_uuid: "7f6abf8b42c24b81b014212faa48007b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40333 } } peers { permanent_uuid: "a22477bc47b84568a27468764caa132c" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 33451 } }
I20260811 18:57:45.210361 8024 heartbeater.cc:503] Master 127.5.226.126:46763 was elected leader, sending a full tablet report...
I20260811 18:57:45.210462 8045 raft_consensus.cc:348] T ddd4d1fad883428da117c772fdcf60d3 P 7f6abf8b42c24b81b014212faa48007b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38113 } } peers { permanent_uuid: "7f6abf8b42c24b81b014212faa48007b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40333 } } peers { permanent_uuid: "a22477bc47b84568a27468764caa132c" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 33451 } }
I20260811 18:57:45.210615 8045 raft_consensus.cc:374] T ddd4d1fad883428da117c772fdcf60d3 P 7f6abf8b42c24b81b014212faa48007b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:45.210651 8045 raft_consensus.cc:729] T ddd4d1fad883428da117c772fdcf60d3 P 7f6abf8b42c24b81b014212faa48007b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f6abf8b42c24b81b014212faa48007b, State: Initialized, Role: FOLLOWER
I20260811 18:57:45.210757 8045 consensus_queue.cc:260] T ddd4d1fad883428da117c772fdcf60d3 P 7f6abf8b42c24b81b014212faa48007b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38113 } } peers { permanent_uuid: "7f6abf8b42c24b81b014212faa48007b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40333 } } peers { permanent_uuid: "a22477bc47b84568a27468764caa132c" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 33451 } }
I20260811 18:57:45.210805 8048 ts_tablet_manager.cc:1428] T ddd4d1fad883428da117c772fdcf60d3 P a22477bc47b84568a27468764caa132c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:57:45.211016 8045 ts_tablet_manager.cc:1428] T ddd4d1fad883428da117c772fdcf60d3 P 7f6abf8b42c24b81b014212faa48007b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:57:45.210983 8046 raft_consensus.cc:348] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38113 } } peers { permanent_uuid: "7f6abf8b42c24b81b014212faa48007b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40333 } } peers { permanent_uuid: "a22477bc47b84568a27468764caa132c" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 33451 } }
I20260811 18:57:45.211095 8046 raft_consensus.cc:374] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:45.211122 8046 raft_consensus.cc:729] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee49ab161bdd4f3e923e6fc1825e42a0, State: Initialized, Role: FOLLOWER
I20260811 18:57:45.211167 7448 heartbeater.cc:503] Master 127.5.226.126:46763 was elected leader, sending a full tablet report...
I20260811 18:57:45.211222 8046 consensus_queue.cc:260] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38113 } } peers { permanent_uuid: "7f6abf8b42c24b81b014212faa48007b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40333 } } peers { permanent_uuid: "a22477bc47b84568a27468764caa132c" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 33451 } }
I20260811 18:57:45.211472 8046 ts_tablet_manager.cc:1428] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:57:45.211608 7731 heartbeater.cc:503] Master 127.5.226.126:46763 was elected leader, sending a full tablet report...
W20260811 18:57:45.264130 7732 tablet.cc:2369] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:45.340778 8058 raft_consensus.cc:482] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:45.340912 8058 raft_consensus.cc:504] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38113 } } peers { permanent_uuid: "7f6abf8b42c24b81b014212faa48007b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40333 } } peers { permanent_uuid: "a22477bc47b84568a27468764caa132c" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 33451 } }
I20260811 18:57:45.341524 8058 leader_election.cc:288] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f6abf8b42c24b81b014212faa48007b (127.5.226.65:40333), a22477bc47b84568a27468764caa132c (127.5.226.67:33451)
I20260811 18:57:45.345094 8040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.341776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:36981 (local address 127.5.226.67:33451)
0811 18:57:45.341851 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.341853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.342086 (+ 233us) server_negotiation.cc:407] Connection header received
0811 18:57:45.342120 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.342121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.342131 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.342181 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:45.342308 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.342967 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.344196 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.344754 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.344816 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.344826 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.344988 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.345026 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 18:57:45.345108 8041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.341774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:41245 (local address 127.5.226.65:40333)
0811 18:57:45.341828 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.341831 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.341839 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:57:45.341867 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.341868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.341878 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.341937 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:45.342093 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.342833 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.344197 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.344742 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.344820 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.344827 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.344987 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.345037 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 18:57:45.345120 8060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.341676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:33451 (local address 127.5.226.66:36981)
0811 18:57:45.342008 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:45.342018 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:45.342077 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:45.342185 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:45.342185 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:45.342186 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:45.342241 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.342242 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.343029 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.343030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.344130 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.344132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.344829 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.344830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.344912 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.344917 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:57:45.344975 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 18:57:45.345020 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"mutex_wait_us":141,"thread_start_us":124,"threads_started":1}
I20260811 18:57:45.345124 7733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.341675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:40333 (local address 127.5.226.66:41245)
0811 18:57:45.341739 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:45.341750 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:45.341792 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:45.341948 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:45.341949 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:45.341950 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:45.342028 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.342031 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.342914 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.342915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.344111 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.344116 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.344829 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.344830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.344919 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.344922 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:57:45.344985 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 18:57:45.345057 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 18:57:45.345752 7361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddd4d1fad883428da117c772fdcf60d3" candidate_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f6abf8b42c24b81b014212faa48007b" is_pre_election: true
I20260811 18:57:45.345695 7928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddd4d1fad883428da117c772fdcf60d3" candidate_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a22477bc47b84568a27468764caa132c" is_pre_election: true
I20260811 18:57:45.345916 7928 raft_consensus.cc:2454] T ddd4d1fad883428da117c772fdcf60d3 P a22477bc47b84568a27468764caa132c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee49ab161bdd4f3e923e6fc1825e42a0 in term 0.
I20260811 18:57:45.345916 7361 raft_consensus.cc:2454] T ddd4d1fad883428da117c772fdcf60d3 P 7f6abf8b42c24b81b014212faa48007b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee49ab161bdd4f3e923e6fc1825e42a0 in term 0.
I20260811 18:57:45.346248 7490 leader_election.cc:302] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f6abf8b42c24b81b014212faa48007b, ee49ab161bdd4f3e923e6fc1825e42a0; no voters:
I20260811 18:57:45.346377 8058 raft_consensus.cc:2781] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:45.346436 8058 raft_consensus.cc:482] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:45.346457 8058 raft_consensus.cc:3037] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:45.347168 8058 raft_consensus.cc:504] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38113 } } peers { permanent_uuid: "7f6abf8b42c24b81b014212faa48007b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40333 } } peers { permanent_uuid: "a22477bc47b84568a27468764caa132c" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 33451 } }
I20260811 18:57:45.347332 8058 leader_election.cc:288] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [CANDIDATE]: Term 1 election: Requested vote from peers 7f6abf8b42c24b81b014212faa48007b (127.5.226.65:40333), a22477bc47b84568a27468764caa132c (127.5.226.67:33451)
I20260811 18:57:45.347497 7361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddd4d1fad883428da117c772fdcf60d3" candidate_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f6abf8b42c24b81b014212faa48007b"
I20260811 18:57:45.347584 7361 raft_consensus.cc:3037] T ddd4d1fad883428da117c772fdcf60d3 P 7f6abf8b42c24b81b014212faa48007b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:45.348320 7361 raft_consensus.cc:2454] T ddd4d1fad883428da117c772fdcf60d3 P 7f6abf8b42c24b81b014212faa48007b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee49ab161bdd4f3e923e6fc1825e42a0 in term 1.
I20260811 18:57:45.348505 7490 leader_election.cc:302] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f6abf8b42c24b81b014212faa48007b, ee49ab161bdd4f3e923e6fc1825e42a0; no voters:
I20260811 18:57:45.348601 8058 raft_consensus.cc:2781] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:45.348608 7928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddd4d1fad883428da117c772fdcf60d3" candidate_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a22477bc47b84568a27468764caa132c"
I20260811 18:57:45.348702 7928 raft_consensus.cc:3037] T ddd4d1fad883428da117c772fdcf60d3 P a22477bc47b84568a27468764caa132c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:45.348778 8058 raft_consensus.cc:686] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [term 1 LEADER]: Becoming Leader. State: Replica: ee49ab161bdd4f3e923e6fc1825e42a0, State: Running, Role: LEADER
I20260811 18:57:45.348973 8058 consensus_queue.cc:237] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38113 } } peers { permanent_uuid: "7f6abf8b42c24b81b014212faa48007b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40333 } } peers { permanent_uuid: "a22477bc47b84568a27468764caa132c" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 33451 } }
I20260811 18:57:45.349556 7928 raft_consensus.cc:2454] T ddd4d1fad883428da117c772fdcf60d3 P a22477bc47b84568a27468764caa132c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee49ab161bdd4f3e923e6fc1825e42a0 in term 1.
I20260811 18:57:45.349977 7067 catalog_manager.cc:5495] T ddd4d1fad883428da117c772fdcf60d3 P ee49ab161bdd4f3e923e6fc1825e42a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee49ab161bdd4f3e923e6fc1825e42a0 (127.5.226.66). New cstate: current_term: 1 leader_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee49ab161bdd4f3e923e6fc1825e42a0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f6abf8b42c24b81b014212faa48007b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a22477bc47b84568a27468764caa132c" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 33451 } health_report { overall_health: UNKNOWN } } }
W20260811 18:57:45.354035 7449 tablet.cc:2369] T ddd4d1fad883428da117c772fdcf60d3 P 7f6abf8b42c24b81b014212faa48007b: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 18:57:45 dist-test-slave-gjw7 krb5kdc[6980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474664, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.65@KRBTEST.COM
I20260811 18:57:45.384389 8041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.377628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43386 (local address 127.5.226.65:40333)
0811 18:57:45.377685 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.377688 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.377802 (+ 114us) server_negotiation.cc:407] Connection header received
0811 18:57:45.377852 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.377853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.377862 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.377908 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:45.378392 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.378864 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.379586 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.379768 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.379818 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.382001 (+ 2183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:45.382013 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:45.382013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:45.382021 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:45.383438 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.383748 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.383751 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.383752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.383821 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.383951 (+ 130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.383951 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.383951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.384081 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:45.384216 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.384254 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.384320 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
Aug 11 18:57:45 dist-test-slave-gjw7 krb5kdc[6980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474665, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:57:45 dist-test-slave-gjw7 krb5kdc[6980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474665, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.226.65@KRBTEST.COM
I20260811 18:57:45.406921 8041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.400761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43394 (local address 127.5.226.65:40333)
0811 18:57:45.400814 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.400816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.400898 (+ 82us) server_negotiation.cc:407] Connection header received
0811 18:57:45.400946 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.400947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.400956 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.400999 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:45.401530 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.401980 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.402701 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.402877 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.402916 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.404891 (+ 1975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:45.404892 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:45.404892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:45.404899 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:45.406017 (+ 1118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.406320 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.406320 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.406321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.406364 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.406530 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.406531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.406531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.406607 (+ 76us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:45.406670 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.406797 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.406854 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260811 18:57:45.414899 8025 tablet.cc:2369] T ddd4d1fad883428da117c772fdcf60d3 P a22477bc47b84568a27468764caa132c: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 18:57:45 dist-test-slave-gjw7 krb5kdc[6980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:57:45 dist-test-slave-gjw7 krb5kdc[6980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.65@KRBTEST.COM
I20260811 18:57:45.428083 8041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.421985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43402 (local address 127.5.226.65:40333)
0811 18:57:45.422047 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.422049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.422099 (+ 50us) server_negotiation.cc:407] Connection header received
0811 18:57:45.422158 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.422159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.422168 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.422213 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:45.422672 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.423127 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.423845 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.424018 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.424064 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.426187 (+ 2123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:45.426188 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:45.426189 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:45.426196 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:45.427288 (+ 1092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.427569 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.427569 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.427570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.427614 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.427739 (+ 125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.427739 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.427740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.427820 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:45.427889 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.427961 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.428014 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260811 18:57:45.428859 7274 tablet_service.cc:2908] Rejecting scan request for tablet ddd4d1fad883428da117c772fdcf60d3: Uninitialized: clean time has not yet been initialized
I20260811 18:57:45.429843 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 7198
I20260811 18:57:45.443606 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 7454
I20260811 18:57:45.458050 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 7736
I20260811 18:57:45.466732 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 7009
2026-08-11T18:57:45Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2254 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:45 dist-test-slave-gjw7 krb5kdc[8098](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:45 dist-test-slave-gjw7 krb5kdc[8098](info): set up 2 sockets
Aug 11 18:57:45 dist-test-slave-gjw7 krb5kdc[8098](info): commencing operation
krb5kdc: starting...
W20260811 18:57:46.675293 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:57:46 dist-test-slave-gjw7 krb5kdc[8098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474666, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 18:57:46.790393 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:35463
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:42743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:35463
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:46.872205 8122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:46.872406 8122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:46.872427 8122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:46.873569 8122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:46.873610 8122 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 18:57:46.873621 8122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:46.873644 8122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:46.873667 8122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:46.873696 8122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:46.875209 8122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:35463
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:35463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:46.875440 8122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:46.875648 8122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:46.880352 8137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:46.880383 8133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:46.880426 8122 server_base.cc:1034] running on GCE node
W20260811 18:57:46.880395 8134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:46.880815 8122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:46.881101 8122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:46.882241 8122 hybrid_clock.cc:648] HybridClock initialized: now 1786474666882227 us; error 30 us; skew 500 ppm
Aug 11 18:57:46 dist-test-slave-gjw7 krb5kdc[8098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474666, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:46.887954 8122 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 18:57:46.888401 8122 webserver.cc:460] Webserver started at http://127.5.226.126:46773/ using document root <none> and password file <none>
I20260811 18:57:46.888607 8122 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:46.888650 8122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:46.888782 8122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:46.889920 8122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "f0bc349026f64d30b643f1331efd9cff"
format_stamp: "Formatted at 2026-08-11 18:57:46 on dist-test-slave-gjw7"
server_key: "8f5bffa02714972a993d549e97306d04"
server_key_iv: "63a48b15f93855ad9850a5c19953764c"
server_key_version: "encryptionkey@0"
I20260811 18:57:46.890273 8122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "f0bc349026f64d30b643f1331efd9cff"
format_stamp: "Formatted at 2026-08-11 18:57:46 on dist-test-slave-gjw7"
server_key: "8f5bffa02714972a993d549e97306d04"
server_key_iv: "63a48b15f93855ad9850a5c19953764c"
server_key_version: "encryptionkey@0"
I20260811 18:57:46.891569 8122 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:57:46.892298 8147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:46.892443 8122 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:46.892529 8122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "f0bc349026f64d30b643f1331efd9cff"
format_stamp: "Formatted at 2026-08-11 18:57:46 on dist-test-slave-gjw7"
server_key: "8f5bffa02714972a993d549e97306d04"
server_key_iv: "63a48b15f93855ad9850a5c19953764c"
server_key_version: "encryptionkey@0"
I20260811 18:57:46.892593 8122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:46.909021 8122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:46.910859 8122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:46.910982 8122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:46.915794 8122 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:35463
I20260811 18:57:46.915884 8272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:35463 every 8 connection(s)
I20260811 18:57:46.916177 8122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:46.916854 8273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:46.919149 8273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff: Bootstrap starting.
I20260811 18:57:46.919740 8273 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:46.920009 8273 log.cc:824] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:46.920647 8273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff: No bootstrap required, opened a new log
I20260811 18:57:46.923069 8273 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0bc349026f64d30b643f1331efd9cff" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35463 } }
I20260811 18:57:46.923213 8273 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:46.923243 8273 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bc349026f64d30b643f1331efd9cff, State: Initialized, Role: FOLLOWER
I20260811 18:57:46.923383 8273 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0bc349026f64d30b643f1331efd9cff" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35463 } }
I20260811 18:57:46.923466 8273 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:46.923499 8273 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:46.923547 8273 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:46.924048 8273 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0bc349026f64d30b643f1331efd9cff" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35463 } }
I20260811 18:57:46.924145 8273 leader_election.cc:302] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0bc349026f64d30b643f1331efd9cff; no voters:
I20260811 18:57:46.924311 8273 leader_election.cc:288] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:46.924371 8277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:46.924533 8277 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [term 1 LEADER]: Becoming Leader. State: Replica: f0bc349026f64d30b643f1331efd9cff, State: Running, Role: LEADER
I20260811 18:57:46.924571 8273 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:46.924618 8277 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0bc349026f64d30b643f1331efd9cff" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35463 } }
I20260811 18:57:46.924974 8282 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0bc349026f64d30b643f1331efd9cff. Latest consensus state: current_term: 1 leader_uuid: "f0bc349026f64d30b643f1331efd9cff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0bc349026f64d30b643f1331efd9cff" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35463 } } }
I20260811 18:57:46.924985 8281 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0bc349026f64d30b643f1331efd9cff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0bc349026f64d30b643f1331efd9cff" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35463 } } }
I20260811 18:57:46.925108 8282 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:46.925148 8281 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:46.925539 8295 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:46.925724 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 8122
I20260811 18:57:46.925814 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:57:46.925974 6025 external_mini_cluster.cc:1428] Setting key a571d58a0d3ebd00b3177eb4bd1a472e
I20260811 18:57:46.926066 8295 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:46.927528 8295 catalog_manager.cc:1347] Generated new cluster ID: fb5d0dd5ee1e4f539c2ba70ae88c37cf
I20260811 18:57:46.927578 8295 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:57:46 dist-test-slave-gjw7 krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474666, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:46.935235 8314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:46.926372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33982 (local address 127.5.226.126:35463)
0811 18:57:46.926924 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:46.926933 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:46.927054 (+ 121us) server_negotiation.cc:407] Connection header received
0811 18:57:46.927170 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:46.927177 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:46.927234 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:46.927368 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:46.928013 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:46.928923 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:46.929713 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:46.930117 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:46.930209 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:46.932309 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:46.932313 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:46.932314 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:46.932326 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:46.933865 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:46.934187 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:46.934190 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:46.934191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:46.934271 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:46.934438 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:46.934439 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:46.934439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:46.934660 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:46.934814 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:46.934907 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 18:57:46.935041 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":71,"threads_started":1}
I20260811 18:57:46.944185 8295 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:46.944890 8295 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:46.957451 8295 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff: Generated new TSK 0
I20260811 18:57:46.957684 8295 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 18:57:46.989861 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35463
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:42743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:47.070851 8323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:47.071038 8323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:47.071062 8323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:47.072162 8323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:47.072211 8323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:47.072229 8323 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:57:47.072258 8323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:57:47.073696 8323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.226.126:35463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:47.073915 8323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:47.074146 8323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:47.078857 8335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:47.078902 8332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:47.078876 8331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:47.079227 8323 server_base.cc:1034] running on GCE node
I20260811 18:57:47.079430 8323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:47.079650 8323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:47.080804 8323 hybrid_clock.cc:648] HybridClock initialized: now 1786474667080788 us; error 27 us; skew 500 ppm
Aug 11 18:57:47 dist-test-slave-gjw7 krb5kdc[8098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474667, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:47.083281 8323 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 18:57:47.083700 8323 webserver.cc:460] Webserver started at http://127.5.226.65:45201/ using document root <none> and password file <none>
I20260811 18:57:47.083916 8323 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:47.083964 8323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:47.084085 8323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:47.085106 8323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "3fb258169825437ea54960dea7c12e2c"
format_stamp: "Formatted at 2026-08-11 18:57:47 on dist-test-slave-gjw7"
server_key: "f105bd8c0af08781f988fc4b2e7f0964"
server_key_iv: "4a0e9ac38ef05ab24fcb8e160e07b03f"
server_key_version: "encryptionkey@0"
I20260811 18:57:47.085464 8323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "3fb258169825437ea54960dea7c12e2c"
format_stamp: "Formatted at 2026-08-11 18:57:47 on dist-test-slave-gjw7"
server_key: "f105bd8c0af08781f988fc4b2e7f0964"
server_key_iv: "4a0e9ac38ef05ab24fcb8e160e07b03f"
server_key_version: "encryptionkey@0"
I20260811 18:57:47.086757 8323 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:47.087476 8349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:47.087641 8323 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:57:47.087746 8323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "3fb258169825437ea54960dea7c12e2c"
format_stamp: "Formatted at 2026-08-11 18:57:47 on dist-test-slave-gjw7"
server_key: "f105bd8c0af08781f988fc4b2e7f0964"
server_key_iv: "4a0e9ac38ef05ab24fcb8e160e07b03f"
server_key_version: "encryptionkey@0"
I20260811 18:57:47.087807 8323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:47.102524 8323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:47.104705 8323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:47.104857 8323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:47.105474 8323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:47.105516 8323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:47.105554 8323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:47.105583 8323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:57:47 dist-test-slave-gjw7 krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474667, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:47.112457 8323 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:37061
I20260811 18:57:47.112563 8571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:37061 every 8 connection(s)
I20260811 18:57:47.112879 8323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 18:57:47.114714 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 8323
I20260811 18:57:47.114823 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:57:47.114858 8314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.106020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:34973 (local address 127.5.226.126:35463)
0811 18:57:47.106088 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.106091 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.106302 (+ 211us) server_negotiation.cc:407] Connection header received
0811 18:57:47.106870 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.106871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.106888 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.106957 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:47.107582 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.108346 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.109474 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.109701 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.109767 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.112147 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:47.112149 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:47.112149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:47.112161 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:47.113693 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.114046 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.114046 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.114047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.114094 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.114277 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.114277 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.114277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.114375 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:47.114422 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.114674 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.114768 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 18:57:47.114955 8371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.105969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35463 (local address 127.5.226.65:34973)
0811 18:57:47.106160 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.106208 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.106751 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.107058 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.107062 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.107314 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:47.107510 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.107515 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.108449 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.108451 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.109388 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.109391 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.109799 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.109801 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.109941 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.110434 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:47.110442 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:47.112050 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:47.113772 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:47.113777 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:47.113779 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:47.113990 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:47.114137 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:47.114137 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:47.114137 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:47.114225 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:47.114418 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:47.114421 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:47.114553 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.114630 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.114748 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":96,"threads_started":1}
I20260811 18:57:47.114995 6025 external_mini_cluster.cc:1428] Setting key db2f97a620daadabd3a2d6610455234e
I20260811 18:57:47.115413 8575 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35463
I20260811 18:57:47.115502 8575 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:47.115675 8575 heartbeater.cc:511] Master 127.5.226.126:35463 requested a full tablet report, sending...
I20260811 18:57:47.116274 8183 ts_manager.cc:194] Registered new tserver with Master: 3fb258169825437ea54960dea7c12e2c (127.5.226.65:37061)
I20260811 18:57:47.117030 8183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:34973
I20260811 18:57:47.122128 8584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.116644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35463 (local address 127.5.226.65:38905)
0811 18:57:47.116780 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.116792 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.116853 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.116967 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.116968 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.117163 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:47.117231 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.117234 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.118062 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.118063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.118783 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.118786 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.119088 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.119089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.119153 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.119539 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:47.119544 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:47.119812 (+ 268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:47.121322 (+ 1510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:47.121324 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:47.121324 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:47.121482 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:47.121662 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:47.121662 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:47.121662 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:47.121706 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:47.121918 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:47.121919 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:47.121953 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.121996 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.122066 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":71,"threads_started":1}
I20260811 18:57:47.122195 8314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.116574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:38905 (local address 127.5.226.126:35463)
0811 18:57:47.116612 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.116614 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.116855 (+ 241us) server_negotiation.cc:407] Connection header received
0811 18:57:47.116901 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.116902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.116911 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.116961 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:47.117360 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.117976 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.118854 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.119027 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.119081 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.119893 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:47.119894 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:47.119895 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:47.119901 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:47.121211 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.121546 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.121547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.121548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.121607 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.121744 (+ 137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.121745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.121745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.121866 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:47.121932 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.122023 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.122107 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 18:57:47.139892 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35463
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:42743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:47.219928 8591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:47.220114 8591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:47.220135 8591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:47.221273 8591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:47.221343 8591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:47.221367 8591 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:57:47.221385 8591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:57:47.222824 8591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.226.126:35463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:47.223035 8591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:47.223241 8591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:47.228009 8604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:47.228026 8606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:47.228222 8591 server_base.cc:1034] running on GCE node
W20260811 18:57:47.228027 8608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:47.228466 8591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:47.228657 8591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:47.229794 8591 hybrid_clock.cc:648] HybridClock initialized: now 1786474667229780 us; error 34 us; skew 500 ppm
Aug 11 18:57:47 dist-test-slave-gjw7 krb5kdc[8098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474667, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:47.232095 8591 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 18:57:47.232499 8591 webserver.cc:460] Webserver started at http://127.5.226.66:36387/ using document root <none> and password file <none>
I20260811 18:57:47.232709 8591 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:47.232756 8591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:47.232877 8591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:47.233899 8591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "74651d1e9bc0400cbc8bb64069246ade"
format_stamp: "Formatted at 2026-08-11 18:57:47 on dist-test-slave-gjw7"
server_key: "dd62bf4c0f5d07556c2f1626a179858b"
server_key_iv: "c0f229b09dcf67384edfeca625c6911d"
server_key_version: "encryptionkey@0"
I20260811 18:57:47.234236 8591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "74651d1e9bc0400cbc8bb64069246ade"
format_stamp: "Formatted at 2026-08-11 18:57:47 on dist-test-slave-gjw7"
server_key: "dd62bf4c0f5d07556c2f1626a179858b"
server_key_iv: "c0f229b09dcf67384edfeca625c6911d"
server_key_version: "encryptionkey@0"
I20260811 18:57:47.235423 8591 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:57:47.236065 8623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:47.236212 8591 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:47.236310 8591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "74651d1e9bc0400cbc8bb64069246ade"
format_stamp: "Formatted at 2026-08-11 18:57:47 on dist-test-slave-gjw7"
server_key: "dd62bf4c0f5d07556c2f1626a179858b"
server_key_iv: "c0f229b09dcf67384edfeca625c6911d"
server_key_version: "encryptionkey@0"
I20260811 18:57:47.236370 8591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:47.252735 8591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:47.254895 8591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:47.255033 8591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:47.255546 8591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:47.255587 8591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:47.255617 8591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:47.255633 8591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:57:47 dist-test-slave-gjw7 krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474667, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:47.262360 8591 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:45801
I20260811 18:57:47.262424 8844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:45801 every 8 connection(s)
I20260811 18:57:47.262708 8591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 18:57:47.264454 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 8591
I20260811 18:57:47.264537 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:57:47.264707 6025 external_mini_cluster.cc:1428] Setting key f748956625772d7f46053c0c8b53afa1
I20260811 18:57:47.265444 8314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.256010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:36837 (local address 127.5.226.126:35463)
0811 18:57:47.256058 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.256061 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.256302 (+ 241us) server_negotiation.cc:407] Connection header received
0811 18:57:47.256835 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.256837 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.256852 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.256913 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:47.257815 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.258596 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.260080 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.260386 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.260453 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.262698 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:47.262699 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:47.262700 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:47.262708 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:47.264043 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.264456 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.264457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.264458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.264523 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.264799 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.264800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.264800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.264918 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:47.264977 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.265242 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.265356 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:57:47.265589 8636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.256010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35463 (local address 127.5.226.66:36837)
0811 18:57:47.256177 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.256214 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.256732 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.257035 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.257040 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.257403 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:47.257697 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.257705 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.258703 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.258704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.259989 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.259993 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.260462 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.260463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.260594 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.261090 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:47.261099 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:47.262610 (+ 1511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:47.264119 (+ 1509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:47.264126 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:47.264128 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:47.264364 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:47.264602 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:47.264603 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:47.264603 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:47.264705 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:47.264979 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:47.264987 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:47.265118 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.265205 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.265386 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":89,"threads_started":1}
I20260811 18:57:47.266037 8845 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35463
I20260811 18:57:47.266134 8845 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:47.266352 8845 heartbeater.cc:511] Master 127.5.226.126:35463 requested a full tablet report, sending...
I20260811 18:57:47.266683 8189 ts_manager.cc:194] Registered new tserver with Master: 74651d1e9bc0400cbc8bb64069246ade (127.5.226.66:45801)
I20260811 18:57:47.267148 8189 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:36837
I20260811 18:57:47.273788 8314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.267034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:40975 (local address 127.5.226.126:35463)
0811 18:57:47.267077 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.267078 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.267301 (+ 223us) server_negotiation.cc:407] Connection header received
0811 18:57:47.267403 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.267404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.267416 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.267458 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:47.267956 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.268615 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.269519 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.269696 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.269745 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.270700 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:47.270701 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:47.270701 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:47.270720 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:47.272443 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.272860 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.272862 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.272862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.272925 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.273122 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.273122 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.273123 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.273343 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:47.273409 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.273606 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.273682 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:57:47.274117 8858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.267082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35463 (local address 127.5.226.66:40975)
0811 18:57:47.267228 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.267240 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.267328 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.267510 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.267511 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.267803 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:47.267866 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.267868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.268727 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.268728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.269449 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.269452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.269770 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.269772 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.269853 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.270244 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:47.270249 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:47.270597 (+ 348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:47.272556 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:47.272557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:47.272557 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:47.272778 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:47.272992 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:47.272993 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:47.272994 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:47.273059 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:47.273441 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:47.273442 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:47.273491 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.273913 (+ 422us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.274025 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 18:57:47.291599 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35463
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:42743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:47.373809 8863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:47.373997 8863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:47.374019 8863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:47.375098 8863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:47.375131 8863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:47.375149 8863 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:57:47.375168 8863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:57:47.376540 8863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.226.126:35463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:47.376709 8863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:47.376876 8863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:47.381569 8877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:47.381661 8874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:47.381793 8863 server_base.cc:1034] running on GCE node
W20260811 18:57:47.381850 8881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:47.382057 8863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:47.382292 8863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:47.383451 8863 hybrid_clock.cc:648] HybridClock initialized: now 1786474667383436 us; error 26 us; skew 500 ppm
Aug 11 18:57:47 dist-test-slave-gjw7 krb5kdc[8098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474667, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:47.385816 8863 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 18:57:47.386262 8863 webserver.cc:460] Webserver started at http://127.5.226.67:45265/ using document root <none> and password file <none>
I20260811 18:57:47.386456 8863 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:47.386497 8863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:47.386620 8863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:47.387609 8863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "f3df3d61fa754539b9d95d0362d9b003"
format_stamp: "Formatted at 2026-08-11 18:57:47 on dist-test-slave-gjw7"
server_key: "8a8fd0e7fe17f66d9d33bb478e782b64"
server_key_iv: "83bdbcbbef1568fe730cc8f80d1f9e48"
server_key_version: "encryptionkey@0"
I20260811 18:57:47.387944 8863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "f3df3d61fa754539b9d95d0362d9b003"
format_stamp: "Formatted at 2026-08-11 18:57:47 on dist-test-slave-gjw7"
server_key: "8a8fd0e7fe17f66d9d33bb478e782b64"
server_key_iv: "83bdbcbbef1568fe730cc8f80d1f9e48"
server_key_version: "encryptionkey@0"
I20260811 18:57:47.389246 8863 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:57:47.389974 8894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:47.390128 8863 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:47.390241 8863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "f3df3d61fa754539b9d95d0362d9b003"
format_stamp: "Formatted at 2026-08-11 18:57:47 on dist-test-slave-gjw7"
server_key: "8a8fd0e7fe17f66d9d33bb478e782b64"
server_key_iv: "83bdbcbbef1568fe730cc8f80d1f9e48"
server_key_version: "encryptionkey@0"
I20260811 18:57:47.390306 8863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:47.414992 8863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:47.417444 8863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:47.417601 8863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:47.418161 8863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:47.418203 8863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:47.418234 8863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:47.418251 8863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:47.424998 8863 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:46533
Aug 11 18:57:47 dist-test-slave-gjw7 krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474667, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:47.425266 9129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:46533 every 8 connection(s)
I20260811 18:57:47.425494 8863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 18:57:47.426445 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 8863
I20260811 18:57:47.426530 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:57:47.426769 6025 external_mini_cluster.cc:1428] Setting key a0a5facdd43ddc47b719916da452014e
I20260811 18:57:47.428390 8314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.418607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:35143 (local address 127.5.226.126:35463)
0811 18:57:47.418674 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.418676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.418861 (+ 185us) server_negotiation.cc:407] Connection header received
0811 18:57:47.419401 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.419403 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.419417 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.419488 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:47.420450 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.421197 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.422698 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.422980 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.423057 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.425653 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:47.425655 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:47.425655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:47.425664 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:47.427214 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.427609 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.427610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.427611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.427674 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.427894 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.427894 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.427895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.427997 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:47.428039 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.428246 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.428308 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 18:57:47.428553 8920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.418558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35463 (local address 127.5.226.67:35143)
0811 18:57:47.418726 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.418769 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.419300 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.419566 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.419570 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.419908 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:47.420337 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.420347 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.421315 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.421317 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.422587 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.422590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.423059 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.423060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.423161 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.423674 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:47.423687 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:47.425550 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:47.427292 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:47.427301 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:47.427303 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:47.427549 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:47.427743 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:47.427743 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:47.427744 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:47.427853 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:47.428037 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:47.428040 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:47.428154 (+ 114us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.428224 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.428355 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":96,"threads_started":1}
I20260811 18:57:47.428958 9132 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35463
I20260811 18:57:47.429045 9132 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:47.429235 9132 heartbeater.cc:511] Master 127.5.226.126:35463 requested a full tablet report, sending...
I20260811 18:57:47.429693 8183 ts_manager.cc:194] Registered new tserver with Master: f3df3d61fa754539b9d95d0362d9b003 (127.5.226.67:46533)
I20260811 18:57:47.430166 8183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:35143
I20260811 18:57:47.434755 8314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.430060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:43083 (local address 127.5.226.126:35463)
0811 18:57:47.430096 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.430098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.430179 (+ 81us) server_negotiation.cc:407] Connection header received
0811 18:57:47.430250 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.430250 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.430260 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.430314 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:47.430691 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.431145 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.431777 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.431947 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.431990 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.432689 (+ 699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:47.432690 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:47.432690 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:47.432696 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:47.433894 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.434167 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.434168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.434168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.434210 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.434422 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.434423 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.434423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.434505 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:47.434547 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.434644 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.434695 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 18:57:47.434777 9144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.430010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35463 (local address 127.5.226.67:43083)
0811 18:57:47.430131 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.430141 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.430192 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.430322 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.430323 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.430517 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:47.430604 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.430606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.431236 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.431237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.431719 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.431721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.431993 (+ 272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.431993 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.432045 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.432370 (+ 325us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:47.432374 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:47.432623 (+ 249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:47.433959 (+ 1336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:47.433960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:47.433960 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:47.434113 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:47.434290 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:47.434291 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:47.434291 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:47.434361 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:47.434548 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:47.434549 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:47.434585 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.434629 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.434713 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":3,"thread_start_us":61,"threads_started":1}
I20260811 18:57:47.438347 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:57:47 dist-test-slave-gjw7 krb5kdc[8098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474667, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:57:47 dist-test-slave-gjw7 krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474667, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:47.460121 8314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.454113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33994 (local address 127.5.226.126:35463)
0811 18:57:47.454172 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.454174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.454183 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:57:47.454205 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.454206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.454215 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.454260 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:47.454805 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.455277 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.456010 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.456191 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.456244 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.458297 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:47.458299 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:47.458299 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:47.458306 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:47.459323 (+ 1017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.459608 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.459608 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.459609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.459651 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.459777 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.459777 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.459778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.459867 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:47.459935 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.459999 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.460055 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 18:57:47.461685 8183 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33994:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:57:47.463230 8183 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:47.469658 9166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.465756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:46533 (local address 127.0.0.1:44006)
0811 18:57:47.465901 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.465911 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.466151 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.466432 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.466433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.466436 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:47.466479 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.466481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.467739 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.467740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.468476 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.468479 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.469367 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.469368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.469448 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.469466 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.469530 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.469583 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":85,"threads_started":1}
I20260811 18:57:47.469763 9165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.465602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:37061 (local address 127.0.0.1:36582)
0811 18:57:47.465733 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.465744 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.465803 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.466104 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.466107 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.466110 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:47.466200 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.466202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.467389 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.467391 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.468624 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.468627 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.469521 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.469522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.469593 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.469598 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.469647 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.469688 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":76,"threads_started":1}
I20260811 18:57:47.469862 9162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.465417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:45801 (local address 127.0.0.1:49958)
0811 18:57:47.465513 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.465552 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.465612 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.466229 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.466230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.466232 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:47.466274 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.466275 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.467628 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.467629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.468674 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.468676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.469646 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.469647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.469705 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.469709 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.469769 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.469806 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"thread_start_us":41,"threads_started":1}
I20260811 18:57:47.470012 9168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.465991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44006 (local address 127.5.226.67:46533)
0811 18:57:47.466260 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.466265 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.466273 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:57:47.466321 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.466323 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.466338 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.466549 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:47.466609 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.467672 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.468556 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.469242 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.469363 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.469430 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.469871 (+ 441us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.469913 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":91,"threads_started":1}
I20260811 18:57:47.470075 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.465761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36582 (local address 127.5.226.65:37061)
0811 18:57:47.465937 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.465943 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.465952 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:57:47.465992 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.465994 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.466008 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.466077 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:47.466360 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.467321 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.468762 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.469411 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.469509 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.469568 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.469945 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.469984 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":110,"threads_started":1}
I20260811 18:57:47.470294 9163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.465524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49958 (local address 127.5.226.66:45801)
0811 18:57:47.466043 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.466049 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.466060 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:57:47.466100 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.466102 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.466117 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.466229 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:47.466395 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.467539 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.468749 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.469544 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.469638 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.469695 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.470155 (+ 460us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.470201 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":75,"threads_started":1}
I20260811 18:57:47.470662 8445 tablet_service.cc:1467] Processing CreateTablet for tablet 616ef6f0bf394a129b36cc09eb5c936a (DEFAULT_TABLE table=test-table [id=12723a08915c48f8b8a6032cda9face1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:47.470672 8998 tablet_service.cc:1467] Processing CreateTablet for tablet 616ef6f0bf394a129b36cc09eb5c936a (DEFAULT_TABLE table=test-table [id=12723a08915c48f8b8a6032cda9face1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:47.470959 8445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 616ef6f0bf394a129b36cc09eb5c936a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:47.470902 8714 tablet_service.cc:1467] Processing CreateTablet for tablet 616ef6f0bf394a129b36cc09eb5c936a (DEFAULT_TABLE table=test-table [id=12723a08915c48f8b8a6032cda9face1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:47.471020 8998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 616ef6f0bf394a129b36cc09eb5c936a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:47.471186 8714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 616ef6f0bf394a129b36cc09eb5c936a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:47.474753 9176 tablet_bootstrap.cc:492] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade: Bootstrap starting.
I20260811 18:57:47.474792 9172 tablet_bootstrap.cc:492] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c: Bootstrap starting.
I20260811 18:57:47.475314 9172 tablet_bootstrap.cc:654] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:47.475342 9176 tablet_bootstrap.cc:654] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:47.475606 9172 log.cc:824] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:47.475613 9176 log.cc:824] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:47.475888 9174 tablet_bootstrap.cc:492] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003: Bootstrap starting.
I20260811 18:57:47.476418 9176 tablet_bootstrap.cc:492] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade: No bootstrap required, opened a new log
I20260811 18:57:47.476496 9176 ts_tablet_manager.cc:1397] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:57:47.476748 9174 tablet_bootstrap.cc:654] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:47.477073 9174 log.cc:824] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:47.477917 9174 tablet_bootstrap.cc:492] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003: No bootstrap required, opened a new log
I20260811 18:57:47.477988 9174 ts_tablet_manager.cc:1397] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:57:47.478497 9176 raft_consensus.cc:348] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.478670 9176 raft_consensus.cc:374] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:47.478713 9176 raft_consensus.cc:729] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74651d1e9bc0400cbc8bb64069246ade, State: Initialized, Role: FOLLOWER
I20260811 18:57:47.478837 9176 consensus_queue.cc:260] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.479115 9176 ts_tablet_manager.cc:1428] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:57:47.479162 8845 heartbeater.cc:503] Master 127.5.226.126:35463 was elected leader, sending a full tablet report...
I20260811 18:57:47.479833 9174 raft_consensus.cc:348] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.479970 9174 raft_consensus.cc:374] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:47.480000 9174 raft_consensus.cc:729] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3df3d61fa754539b9d95d0362d9b003, State: Initialized, Role: FOLLOWER
I20260811 18:57:47.480111 9174 consensus_queue.cc:260] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.480371 9174 ts_tablet_manager.cc:1428] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:57:47.480397 9132 heartbeater.cc:503] Master 127.5.226.126:35463 was elected leader, sending a full tablet report...
I20260811 18:57:47.480733 9172 tablet_bootstrap.cc:492] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c: No bootstrap required, opened a new log
I20260811 18:57:47.480809 9172 ts_tablet_manager.cc:1397] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260811 18:57:47.482386 9172 raft_consensus.cc:348] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.482509 9172 raft_consensus.cc:374] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:47.482542 9172 raft_consensus.cc:729] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fb258169825437ea54960dea7c12e2c, State: Initialized, Role: FOLLOWER
I20260811 18:57:47.482645 9172 consensus_queue.cc:260] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.482883 9172 ts_tablet_manager.cc:1428] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:57:47.482954 8575 heartbeater.cc:503] Master 127.5.226.126:35463 was elected leader, sending a full tablet report...
W20260811 18:57:47.513476 8847 tablet.cc:2369] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:47.523159 9188 raft_consensus.cc:482] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:47.523303 9188 raft_consensus.cc:504] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.523658 9188 leader_election.cc:288] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74651d1e9bc0400cbc8bb64069246ade (127.5.226.66:45801), f3df3d61fa754539b9d95d0362d9b003 (127.5.226.67:46533)
I20260811 18:57:47.526603 9163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.523918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:59851 (local address 127.5.226.66:45801)
0811 18:57:47.523980 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.523982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.523993 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:57:47.524024 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.524025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.524034 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.524088 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:47.524312 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.524876 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.525919 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.526295 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.526360 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.526370 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.526506 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.526543 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 18:57:47.526603 8371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.523836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:45801 (local address 127.5.226.65:59851)
0811 18:57:47.523896 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.523910 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.523961 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.524145 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.524147 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.524149 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:47.524233 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.524234 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.524958 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.524959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.525833 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.525836 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.526365 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.526366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.526442 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.526446 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.526490 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.526527 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":20}
I20260811 18:57:47.526916 8755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616ef6f0bf394a129b36cc09eb5c936a" candidate_uuid: "3fb258169825437ea54960dea7c12e2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74651d1e9bc0400cbc8bb64069246ade" is_pre_election: true
I20260811 18:57:47.527047 8755 raft_consensus.cc:2454] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fb258169825437ea54960dea7c12e2c in term 0.
I20260811 18:57:47.527201 9168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.524098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:38605 (local address 127.5.226.67:46533)
0811 18:57:47.524140 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.524142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.524255 (+ 113us) server_negotiation.cc:407] Connection header received
0811 18:57:47.524312 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.524313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.524322 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.524368 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:47.524605 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.525138 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.526252 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.526622 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.526681 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.526690 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.527097 (+ 407us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.527139 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:57:47.527212 9190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.524016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:46533 (local address 127.5.226.65:38605)
0811 18:57:47.524186 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.524195 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.524254 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.524376 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.524377 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.524378 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:47.524497 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.524500 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.525214 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.525215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.526170 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.526174 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.526939 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.526940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.527001 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.527005 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.527085 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.527121 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":21,"thread_start_us":121,"threads_started":1}
I20260811 18:57:47.527287 8356 leader_election.cc:302] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fb258169825437ea54960dea7c12e2c, 74651d1e9bc0400cbc8bb64069246ade; no voters:
I20260811 18:57:47.527433 9188 raft_consensus.cc:2781] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:47.527499 9188 raft_consensus.cc:482] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:47.527534 9188 raft_consensus.cc:3037] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:47.527657 9040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616ef6f0bf394a129b36cc09eb5c936a" candidate_uuid: "3fb258169825437ea54960dea7c12e2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3df3d61fa754539b9d95d0362d9b003" is_pre_election: true
I20260811 18:57:47.527815 9040 raft_consensus.cc:2454] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fb258169825437ea54960dea7c12e2c in term 0.
I20260811 18:57:47.528848 9188 raft_consensus.cc:504] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.528959 9188 leader_election.cc:288] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [CANDIDATE]: Term 1 election: Requested vote from peers 74651d1e9bc0400cbc8bb64069246ade (127.5.226.66:45801), f3df3d61fa754539b9d95d0362d9b003 (127.5.226.67:46533)
I20260811 18:57:47.529145 8755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616ef6f0bf394a129b36cc09eb5c936a" candidate_uuid: "3fb258169825437ea54960dea7c12e2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74651d1e9bc0400cbc8bb64069246ade"
I20260811 18:57:47.529189 9040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616ef6f0bf394a129b36cc09eb5c936a" candidate_uuid: "3fb258169825437ea54960dea7c12e2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3df3d61fa754539b9d95d0362d9b003"
I20260811 18:57:47.529249 9040 raft_consensus.cc:3037] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:47.529239 8755 raft_consensus.cc:3037] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:47.530048 9040 raft_consensus.cc:2454] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fb258169825437ea54960dea7c12e2c in term 1.
I20260811 18:57:47.530094 8755 raft_consensus.cc:2454] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fb258169825437ea54960dea7c12e2c in term 1.
I20260811 18:57:47.530264 8356 leader_election.cc:302] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fb258169825437ea54960dea7c12e2c, 74651d1e9bc0400cbc8bb64069246ade; no voters:
I20260811 18:57:47.530355 9188 raft_consensus.cc:2781] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:47.530499 9188 raft_consensus.cc:686] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [term 1 LEADER]: Becoming Leader. State: Replica: 3fb258169825437ea54960dea7c12e2c, State: Running, Role: LEADER
I20260811 18:57:47.530604 9188 consensus_queue.cc:237] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.531421 8183 catalog_manager.cc:5495] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fb258169825437ea54960dea7c12e2c (127.5.226.65). New cstate: current_term: 1 leader_uuid: "3fb258169825437ea54960dea7c12e2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260811 18:57:47.543496 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.541138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36596 (local address 127.5.226.65:37061)
0811 18:57:47.541212 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.541214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.541223 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:57:47.541323 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.541323 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.541342 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.541394 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:47.541542 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.541988 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.542763 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.542945 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.542998 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.543194 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:47.543297 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:47.543364 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.543409 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.543428 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 18:57:47.545280 9040 raft_consensus.cc:1261] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003 [term 1 FOLLOWER]: Refusing update from remote peer 3fb258169825437ea54960dea7c12e2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:47.545280 8755 raft_consensus.cc:1261] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade [term 1 FOLLOWER]: Refusing update from remote peer 3fb258169825437ea54960dea7c12e2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:47.545678 9188 consensus_queue.cc:1035] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:47.547827 9195 mvcc.cc:205] Tried to move back new op lower bound from 7317400238262394880 to 7317400238205890560. Current Snapshot: MvccSnapshot[applied={T|T < 7317400238262394880}]
I20260811 18:57:47.547983 9191 consensus_queue.cc:1035] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:47.548606 9197 mvcc.cc:205] Tried to move back new op lower bound from 7317400238262394880 to 7317400238205890560. Current Snapshot: MvccSnapshot[applied={T|T < 7317400238262394880 or (T in {7317400238262394880})}]
I20260811 18:57:47.552887 8183 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:47.553025 8183 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:47.553936 8183 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff: Sending DeleteTablet for 3 replicas of tablet 616ef6f0bf394a129b36cc09eb5c936a
I20260811 18:57:47.554414 8445 tablet_service.cc:1514] Processing DeleteTablet for tablet 616ef6f0bf394a129b36cc09eb5c936a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:47 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:36582
I20260811 18:57:47.554415 8714 tablet_service.cc:1514] Processing DeleteTablet for tablet 616ef6f0bf394a129b36cc09eb5c936a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:47 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:49958
I20260811 18:57:47.554677 9213 tablet_replica.cc:330] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade: stopping tablet replica
I20260811 18:57:47.554711 8998 tablet_service.cc:1514] Processing DeleteTablet for tablet 616ef6f0bf394a129b36cc09eb5c936a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:47 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:44006
I20260811 18:57:47.554771 9214 tablet_replica.cc:330] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c: stopping tablet replica
I20260811 18:57:47.554845 9214 raft_consensus.cc:2229] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:57:47.554839 9213 raft_consensus.cc:2229] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:47.554953 9213 raft_consensus.cc:2258] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:47.554953 9214 raft_consensus.cc:2258] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:47.555001 8183 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33994:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:57:47.555150 8183 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:47.555450 9214 ts_tablet_manager.cc:1905] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:47.555526 9213 ts_tablet_manager.cc:1905] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:47.556828 8445 tablet_service.cc:1467] Processing CreateTablet for tablet ced4228b86424716b6de60058d7d16a9 (DEFAULT_TABLE table=test-table [id=895a74e6ef5e45919a2b15a8c8fb53c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:47.556948 8445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ced4228b86424716b6de60058d7d16a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:47.557075 9214 ts_tablet_manager.cc:1918] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:47.557152 9214 log.cc:1196] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/wal/wals/616ef6f0bf394a129b36cc09eb5c936a
I20260811 18:57:47.557439 9214 ts_tablet_manager.cc:1939] T 616ef6f0bf394a129b36cc09eb5c936a P 3fb258169825437ea54960dea7c12e2c: Deleting consensus metadata
I20260811 18:57:47.557508 9213 ts_tablet_manager.cc:1918] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:47.557600 9213 log.cc:1196] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/616ef6f0bf394a129b36cc09eb5c936a
I20260811 18:57:47.557670 8998 tablet_service.cc:1467] Processing CreateTablet for tablet ced4228b86424716b6de60058d7d16a9 (DEFAULT_TABLE table=test-table [id=895a74e6ef5e45919a2b15a8c8fb53c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:47.557794 8998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ced4228b86424716b6de60058d7d16a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:47.557850 8151 catalog_manager.cc:4841] TS 3fb258169825437ea54960dea7c12e2c (127.5.226.65:37061): tablet 616ef6f0bf394a129b36cc09eb5c936a (table test-table [id=12723a08915c48f8b8a6032cda9face1]) successfully deleted
I20260811 18:57:47.558019 9213 ts_tablet_manager.cc:1939] T 616ef6f0bf394a129b36cc09eb5c936a P 74651d1e9bc0400cbc8bb64069246ade: Deleting consensus metadata
I20260811 18:57:47.558434 8151 catalog_manager.cc:4841] TS 74651d1e9bc0400cbc8bb64069246ade (127.5.226.66:45801): tablet 616ef6f0bf394a129b36cc09eb5c936a (table test-table [id=12723a08915c48f8b8a6032cda9face1]) successfully deleted
I20260811 18:57:47.559110 9174 tablet_bootstrap.cc:492] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003: Bootstrap starting.
I20260811 18:57:47.559185 8714 tablet_service.cc:1467] Processing CreateTablet for tablet ced4228b86424716b6de60058d7d16a9 (DEFAULT_TABLE table=test-table [id=895a74e6ef5e45919a2b15a8c8fb53c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:47.559291 8714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ced4228b86424716b6de60058d7d16a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:47.559693 9174 tablet_bootstrap.cc:654] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:47.560259 9174 tablet_bootstrap.cc:492] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003: No bootstrap required, opened a new log
I20260811 18:57:47.560304 9174 ts_tablet_manager.cc:1397] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:47.560438 9176 tablet_bootstrap.cc:492] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade: Bootstrap starting.
I20260811 18:57:47.560461 9174 raft_consensus.cc:348] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.560532 9174 raft_consensus.cc:374] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:47.560551 9174 raft_consensus.cc:729] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3df3d61fa754539b9d95d0362d9b003, State: Initialized, Role: FOLLOWER
I20260811 18:57:47.560595 9174 consensus_queue.cc:260] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.560672 9174 ts_tablet_manager.cc:1428] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:47.560847 9176 tablet_bootstrap.cc:654] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:47.561367 9172 tablet_bootstrap.cc:492] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c: Bootstrap starting.
I20260811 18:57:47.561631 9176 tablet_bootstrap.cc:492] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade: No bootstrap required, opened a new log
I20260811 18:57:47.561646 9215 tablet_replica.cc:330] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003: stopping tablet replica
I20260811 18:57:47.561663 9176 ts_tablet_manager.cc:1397] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:47.561755 9215 raft_consensus.cc:2229] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:47.561815 9172 tablet_bootstrap.cc:654] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:47.561865 9215 raft_consensus.cc:2258] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:47.561942 9176 raft_consensus.cc:348] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.562016 9176 raft_consensus.cc:374] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:47.562036 9176 raft_consensus.cc:729] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74651d1e9bc0400cbc8bb64069246ade, State: Initialized, Role: FOLLOWER
I20260811 18:57:47.562088 9176 consensus_queue.cc:260] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.562181 9176 ts_tablet_manager.cc:1428] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:47.562515 9215 ts_tablet_manager.cc:1905] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:47.564175 9215 ts_tablet_manager.cc:1918] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:47.564257 9215 log.cc:1196] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/616ef6f0bf394a129b36cc09eb5c936a
I20260811 18:57:47.564337 9172 tablet_bootstrap.cc:492] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c: No bootstrap required, opened a new log
I20260811 18:57:47.564386 9172 ts_tablet_manager.cc:1397] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 18:57:47.564555 9215 ts_tablet_manager.cc:1939] T 616ef6f0bf394a129b36cc09eb5c936a P f3df3d61fa754539b9d95d0362d9b003: Deleting consensus metadata
I20260811 18:57:47.564543 9172 raft_consensus.cc:348] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.564617 9172 raft_consensus.cc:374] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:47.564636 9172 raft_consensus.cc:729] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fb258169825437ea54960dea7c12e2c, State: Initialized, Role: FOLLOWER
I20260811 18:57:47.564678 9172 consensus_queue.cc:260] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.564764 9172 ts_tablet_manager.cc:1428] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:47.565169 8151 catalog_manager.cc:4841] TS f3df3d61fa754539b9d95d0362d9b003 (127.5.226.67:46533): tablet 616ef6f0bf394a129b36cc09eb5c936a (table test-table [id=12723a08915c48f8b8a6032cda9face1]) successfully deleted
I20260811 18:57:47.572993 9186 raft_consensus.cc:482] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:47.573078 9186 raft_consensus.cc:504] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.573417 9186 leader_election.cc:288] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fb258169825437ea54960dea7c12e2c (127.5.226.65:37061), 74651d1e9bc0400cbc8bb64069246ade (127.5.226.66:45801)
I20260811 18:57:47.576944 9163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.573827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:53617 (local address 127.5.226.66:45801)
0811 18:57:47.573871 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.573872 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.573896 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:57:47.573959 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.573960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.573969 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.574013 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:47.574200 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.574939 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.576175 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.576552 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.576616 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.576626 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.576821 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.576873 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:57:47.576936 9222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.573679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:45801 (local address 127.5.226.67:53617)
0811 18:57:47.573839 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.573849 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.573912 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.574015 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.574016 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.574018 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:47.574106 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.574107 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.575025 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.575026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.576102 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.576104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.576625 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.576626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.576705 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.576710 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.576789 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.576834 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":84,"threads_started":1}
I20260811 18:57:47.577090 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.573657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:50891 (local address 127.5.226.65:37061)
0811 18:57:47.573729 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.573731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.573904 (+ 173us) server_negotiation.cc:407] Connection header received
0811 18:57:47.573930 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.573931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.573942 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.573982 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:47.574160 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.574667 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.576044 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.576638 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.576713 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.576721 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.576987 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.577032 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 18:57:47.576956 8920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.573580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:37061 (local address 127.5.226.67:50891)
0811 18:57:47.573794 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.573807 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.573852 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.574023 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.574024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.574025 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:47.574088 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.574090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.574746 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.574747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.575944 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.575948 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.576720 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.576721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.576797 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.576800 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.576842 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.576873 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193}
I20260811 18:57:47.577180 8755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ced4228b86424716b6de60058d7d16a9" candidate_uuid: "f3df3d61fa754539b9d95d0362d9b003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74651d1e9bc0400cbc8bb64069246ade" is_pre_election: true
I20260811 18:57:47.577280 8755 raft_consensus.cc:2454] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3df3d61fa754539b9d95d0362d9b003 in term 0.
I20260811 18:57:47.577464 8486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ced4228b86424716b6de60058d7d16a9" candidate_uuid: "f3df3d61fa754539b9d95d0362d9b003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fb258169825437ea54960dea7c12e2c" is_pre_election: true
I20260811 18:57:47.577591 8486 raft_consensus.cc:2454] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3df3d61fa754539b9d95d0362d9b003 in term 0.
I20260811 18:57:47.577806 8900 leader_election.cc:302] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fb258169825437ea54960dea7c12e2c, f3df3d61fa754539b9d95d0362d9b003; no voters:
I20260811 18:57:47.577982 9186 raft_consensus.cc:2781] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:47.578037 9186 raft_consensus.cc:482] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:47.578066 9186 raft_consensus.cc:3037] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:47.578960 9186 raft_consensus.cc:504] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.579098 9186 leader_election.cc:288] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [CANDIDATE]: Term 1 election: Requested vote from peers 3fb258169825437ea54960dea7c12e2c (127.5.226.65:37061), 74651d1e9bc0400cbc8bb64069246ade (127.5.226.66:45801)
I20260811 18:57:47.579263 8486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ced4228b86424716b6de60058d7d16a9" candidate_uuid: "f3df3d61fa754539b9d95d0362d9b003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fb258169825437ea54960dea7c12e2c"
I20260811 18:57:47.579341 8486 raft_consensus.cc:3037] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:47.579311 8755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ced4228b86424716b6de60058d7d16a9" candidate_uuid: "f3df3d61fa754539b9d95d0362d9b003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74651d1e9bc0400cbc8bb64069246ade"
I20260811 18:57:47.579387 8755 raft_consensus.cc:3037] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:47.579977 8486 raft_consensus.cc:2454] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3df3d61fa754539b9d95d0362d9b003 in term 1.
I20260811 18:57:47.580116 8755 raft_consensus.cc:2454] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3df3d61fa754539b9d95d0362d9b003 in term 1.
I20260811 18:57:47.580144 8900 leader_election.cc:302] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fb258169825437ea54960dea7c12e2c, f3df3d61fa754539b9d95d0362d9b003; no voters:
I20260811 18:57:47.580224 9186 raft_consensus.cc:2781] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:47.580340 9186 raft_consensus.cc:686] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [term 1 LEADER]: Becoming Leader. State: Replica: f3df3d61fa754539b9d95d0362d9b003, State: Running, Role: LEADER
I20260811 18:57:47.580402 9186 consensus_queue.cc:237] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.581053 8189 catalog_manager.cc:5495] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3df3d61fa754539b9d95d0362d9b003 (127.5.226.67). New cstate: current_term: 1 leader_uuid: "f3df3d61fa754539b9d95d0362d9b003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } health_report { overall_health: HEALTHY } } }
Aug 11 18:57:47 dist-test-slave-gjw7 krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474666, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:47.605451 9241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.597972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35463 (local address 127.0.0.1:34002)
0811 18:57:47.598144 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.598156 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.598231 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.598368 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.598369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.598766 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:47.598824 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.598827 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.599507 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.599508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.600376 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.600378 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.600696 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.600697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.600757 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.601277 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:47.601312 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:47.602905 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:47.604347 (+ 1442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:47.604355 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:47.604358 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:47.604616 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:47.604781 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:47.604781 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:47.604782 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:47.604849 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:47.605046 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:47.605054 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:47.605108 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.605177 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.605339 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
I20260811 18:57:47.605552 8314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.598027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34002 (local address 127.5.226.126:35463)
0811 18:57:47.598086 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.598088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.598245 (+ 157us) server_negotiation.cc:407] Connection header received
0811 18:57:47.598279 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.598280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.598291 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.598353 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:47.598923 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.599435 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.600455 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.600637 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.600684 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.602997 (+ 2313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:47.602998 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:47.602999 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:47.603006 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:47.604273 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.604683 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.604683 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.604684 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.604732 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.604900 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.604901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.604901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.604995 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:47.605040 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.605192 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.605427 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":115,"server-negotiator.queue_time_us":31}
I20260811 18:57:47.607848 8189 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:34002:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 18:57:47.608145 8189 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:47.609598 8998 tablet_service.cc:1467] Processing CreateTablet for tablet 1ef29bfe9f88469c9cceca48348f32ab (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8c7ffdf2ca8a491abf9d465f283ad33d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:57:47.609602 8714 tablet_service.cc:1467] Processing CreateTablet for tablet 1ef29bfe9f88469c9cceca48348f32ab (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8c7ffdf2ca8a491abf9d465f283ad33d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:57:47.609547 8445 tablet_service.cc:1467] Processing CreateTablet for tablet 1ef29bfe9f88469c9cceca48348f32ab (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8c7ffdf2ca8a491abf9d465f283ad33d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:57:47.609760 8998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ef29bfe9f88469c9cceca48348f32ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:47.609760 8714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ef29bfe9f88469c9cceca48348f32ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:47.609760 8445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ef29bfe9f88469c9cceca48348f32ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:47.611289 9172 tablet_bootstrap.cc:492] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c: Bootstrap starting.
I20260811 18:57:47.611660 9172 tablet_bootstrap.cc:654] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:47.611992 9174 tablet_bootstrap.cc:492] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003: Bootstrap starting.
I20260811 18:57:47.612278 9172 tablet_bootstrap.cc:492] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c: No bootstrap required, opened a new log
I20260811 18:57:47.612347 9172 ts_tablet_manager.cc:1397] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:47.612360 9174 tablet_bootstrap.cc:654] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:47.612489 9172 raft_consensus.cc:348] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.612553 9172 raft_consensus.cc:374] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:47.612569 9172 raft_consensus.cc:729] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fb258169825437ea54960dea7c12e2c, State: Initialized, Role: FOLLOWER
I20260811 18:57:47.612614 9172 consensus_queue.cc:260] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.612694 9172 ts_tablet_manager.cc:1428] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:47.612689 9176 tablet_bootstrap.cc:492] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade: Bootstrap starting.
I20260811 18:57:47.612739 9191 tablet_replica.cc:439] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } } }
I20260811 18:57:47.612826 9191 tablet_replica.cc:442] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:57:47.613062 9176 tablet_bootstrap.cc:654] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:47.613686 9176 tablet_bootstrap.cc:492] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade: No bootstrap required, opened a new log
I20260811 18:57:47.613736 9176 ts_tablet_manager.cc:1397] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
W20260811 18:57:47.613742 8576 tablet.cc:2369] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:47.613884 9176 raft_consensus.cc:348] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.613942 9176 raft_consensus.cc:374] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:47.613960 9176 raft_consensus.cc:729] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74651d1e9bc0400cbc8bb64069246ade, State: Initialized, Role: FOLLOWER
I20260811 18:57:47.614005 9176 consensus_queue.cc:260] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.614086 9176 ts_tablet_manager.cc:1428] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:47.614147 9185 tablet_replica.cc:439] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } } }
I20260811 18:57:47.614243 9185 tablet_replica.cc:442] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:57:47.614409 9174 tablet_bootstrap.cc:492] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003: No bootstrap required, opened a new log
I20260811 18:57:47.614459 9174 ts_tablet_manager.cc:1397] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:57:47.614598 9174 raft_consensus.cc:348] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.614652 9174 raft_consensus.cc:374] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:47.614670 9174 raft_consensus.cc:729] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3df3d61fa754539b9d95d0362d9b003, State: Initialized, Role: FOLLOWER
I20260811 18:57:47.614718 9174 consensus_queue.cc:260] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.614801 9174 ts_tablet_manager.cc:1428] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:47.614895 9186 tablet_replica.cc:439] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } } }
I20260811 18:57:47.614946 9186 tablet_replica.cc:442] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003: This TxnStatusTablet replica's current role is: FOLLOWER
W20260811 18:57:47.676342 9133 tablet.cc:2369] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:47.730129 9186 raft_consensus.cc:482] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:47.730270 9186 raft_consensus.cc:504] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.730469 9186 leader_election.cc:288] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fb258169825437ea54960dea7c12e2c (127.5.226.65:37061), 74651d1e9bc0400cbc8bb64069246ade (127.5.226.66:45801)
I20260811 18:57:47.730736 8486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef29bfe9f88469c9cceca48348f32ab" candidate_uuid: "f3df3d61fa754539b9d95d0362d9b003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fb258169825437ea54960dea7c12e2c" is_pre_election: true
I20260811 18:57:47.730778 8755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef29bfe9f88469c9cceca48348f32ab" candidate_uuid: "f3df3d61fa754539b9d95d0362d9b003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74651d1e9bc0400cbc8bb64069246ade" is_pre_election: true
I20260811 18:57:47.730850 8486 raft_consensus.cc:2454] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3df3d61fa754539b9d95d0362d9b003 in term 0.
I20260811 18:57:47.730880 8755 raft_consensus.cc:2454] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3df3d61fa754539b9d95d0362d9b003 in term 0.
I20260811 18:57:47.731076 8900 leader_election.cc:302] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fb258169825437ea54960dea7c12e2c, f3df3d61fa754539b9d95d0362d9b003; no voters:
I20260811 18:57:47.731209 9186 raft_consensus.cc:2781] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:47.731256 9186 raft_consensus.cc:482] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:47.731276 9186 raft_consensus.cc:3037] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:47.731966 9186 raft_consensus.cc:504] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.732084 9186 leader_election.cc:288] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [CANDIDATE]: Term 1 election: Requested vote from peers 3fb258169825437ea54960dea7c12e2c (127.5.226.65:37061), 74651d1e9bc0400cbc8bb64069246ade (127.5.226.66:45801)
I20260811 18:57:47.732276 8755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef29bfe9f88469c9cceca48348f32ab" candidate_uuid: "f3df3d61fa754539b9d95d0362d9b003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74651d1e9bc0400cbc8bb64069246ade"
I20260811 18:57:47.732277 8486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef29bfe9f88469c9cceca48348f32ab" candidate_uuid: "f3df3d61fa754539b9d95d0362d9b003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fb258169825437ea54960dea7c12e2c"
I20260811 18:57:47.732358 8755 raft_consensus.cc:3037] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:47.732358 8486 raft_consensus.cc:3037] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:47.733132 8486 raft_consensus.cc:2454] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3df3d61fa754539b9d95d0362d9b003 in term 1.
I20260811 18:57:47.733132 8755 raft_consensus.cc:2454] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3df3d61fa754539b9d95d0362d9b003 in term 1.
I20260811 18:57:47.733343 8900 leader_election.cc:302] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74651d1e9bc0400cbc8bb64069246ade, f3df3d61fa754539b9d95d0362d9b003; no voters:
I20260811 18:57:47.733448 9186 raft_consensus.cc:2781] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:47.733505 9186 raft_consensus.cc:686] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [term 1 LEADER]: Becoming Leader. State: Replica: f3df3d61fa754539b9d95d0362d9b003, State: Running, Role: LEADER
I20260811 18:57:47.733557 9186 consensus_queue.cc:237] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } }
I20260811 18:57:47.733906 9225 tablet_replica.cc:439] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003: TxnStatusTablet state changed. Reason: New leader f3df3d61fa754539b9d95d0362d9b003. Latest consensus state: current_term: 1 leader_uuid: "f3df3d61fa754539b9d95d0362d9b003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } } }
I20260811 18:57:47.733985 9225 tablet_replica.cc:442] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:57:47.734207 9248 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 18:57:47.734241 8189 catalog_manager.cc:5495] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3df3d61fa754539b9d95d0362d9b003 (127.5.226.67). New cstate: current_term: 1 leader_uuid: "f3df3d61fa754539b9d95d0362d9b003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } health_report { overall_health: HEALTHY } } }
I20260811 18:57:47.734345 9248 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 18:57:47.761650 9241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.759207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:46533 (local address 127.0.0.1:44018)
0811 18:57:47.759277 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.759302 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.759363 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.759538 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.759539 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.759540 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:57:47.759595 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.759597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.760222 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.760223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.760783 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.760784 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.761119 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.761121 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.761184 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.761199 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:57:47.761484 (+ 285us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:57:47.761493 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.761532 (+ 39us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.761579 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 18:57:47.761668 9168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.759237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44018 (local address 127.5.226.67:46533)
0811 18:57:47.759285 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.759287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.759348 (+ 61us) server_negotiation.cc:407] Connection header received
0811 18:57:47.759452 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.759453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.759472 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.759527 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:47.759649 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.760146 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.760855 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.761056 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.761111 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.761282 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:47.761425 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:47.761488 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.761545 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.761565 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 18:57:47.763195 8755 raft_consensus.cc:1261] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade [term 1 FOLLOWER]: Refusing update from remote peer f3df3d61fa754539b9d95d0362d9b003: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:47.763286 8486 raft_consensus.cc:1261] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c [term 1 FOLLOWER]: Refusing update from remote peer f3df3d61fa754539b9d95d0362d9b003: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:47.763453 9225 consensus_queue.cc:1035] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:47.763567 9186 consensus_queue.cc:1035] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:47.764181 9185 tablet_replica.cc:439] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade: TxnStatusTablet state changed. Reason: New leader f3df3d61fa754539b9d95d0362d9b003. Latest consensus state: current_term: 1 leader_uuid: "f3df3d61fa754539b9d95d0362d9b003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } } }
I20260811 18:57:47.764288 9185 tablet_replica.cc:442] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:57:47.764719 9191 tablet_replica.cc:439] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c: TxnStatusTablet state changed. Reason: New leader f3df3d61fa754539b9d95d0362d9b003. Latest consensus state: current_term: 1 leader_uuid: "f3df3d61fa754539b9d95d0362d9b003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } } }
I20260811 18:57:47.764823 9191 tablet_replica.cc:442] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:57:47.765087 9225 tablet_replica.cc:439] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f3df3d61fa754539b9d95d0362d9b003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } } }
I20260811 18:57:47.765169 9225 tablet_replica.cc:442] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:57:47.766207 9191 tablet_replica.cc:439] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f3df3d61fa754539b9d95d0362d9b003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } } }
I20260811 18:57:47.766309 9191 tablet_replica.cc:442] T 1ef29bfe9f88469c9cceca48348f32ab P 3fb258169825437ea54960dea7c12e2c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:57:47.766898 9257 tablet_replica.cc:439] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f3df3d61fa754539b9d95d0362d9b003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } } }
I20260811 18:57:47.767028 9257 tablet_replica.cc:442] T 1ef29bfe9f88469c9cceca48348f32ab P f3df3d61fa754539b9d95d0362d9b003: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:57:47.767154 9204 mvcc.cc:205] Tried to move back new op lower bound from 7317400239155781632 to 7317400239037009920. Current Snapshot: MvccSnapshot[applied={T|T < 7317400239155781632}]
I20260811 18:57:47.767344 9185 tablet_replica.cc:439] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f3df3d61fa754539b9d95d0362d9b003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 } } peers { permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 } } peers { permanent_uuid: "f3df3d61fa754539b9d95d0362d9b003" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46533 } } }
I20260811 18:57:47.767446 9185 tablet_replica.cc:442] T 1ef29bfe9f88469c9cceca48348f32ab P 74651d1e9bc0400cbc8bb64069246ade: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:57:47.770301 9168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.768152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44022 (local address 127.5.226.67:46533)
0811 18:57:47.768187 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.768189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.768196 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:57:47.768275 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.768275 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.768288 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.768335 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:47.768458 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.768983 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.769715 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.769915 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.769968 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.770090 (+ 122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:47.770123 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:47.770165 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.770211 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.770229 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 18:57:47.775446 9168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.772922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:45197 (local address 127.5.226.67:46533)
0811 18:57:47.772960 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.772962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.773028 (+ 66us) server_negotiation.cc:407] Connection header received
0811 18:57:47.773097 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.773097 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.773105 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.773142 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:47.773309 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.773719 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.774829 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.774998 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.775044 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.775242 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:47.775262 (+ 20us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:47.775307 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.775372 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.775384 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:57:47.775530 9144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.772884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:46533 (local address 127.5.226.67:45197)
0811 18:57:47.772977 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:47.772988 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:47.773038 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:47.773170 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:47.773171 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:47.773172 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:57:47.773232 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.773234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.773785 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.773786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.774753 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:47.774756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.775065 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.775066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:47.775133 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.775160 (+ 27us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:57:47.775317 (+ 157us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:57:47.775318 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 18:57:47.775372 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 18:57:47.775411 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 18:57:47.777846 8486 raft_consensus.cc:1261] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c [term 1 FOLLOWER]: Refusing update from remote peer f3df3d61fa754539b9d95d0362d9b003: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:47.777848 8755 raft_consensus.cc:1261] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade [term 1 FOLLOWER]: Refusing update from remote peer f3df3d61fa754539b9d95d0362d9b003: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:47.778064 9225 consensus_queue.cc:1035] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fb258169825437ea54960dea7c12e2c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 37061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:47.778164 9257 consensus_queue.cc:1035] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74651d1e9bc0400cbc8bb64069246ade" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:47.790277 8183 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:47.790371 8183 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:47.790956 8183 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f0bc349026f64d30b643f1331efd9cff: Sending DeleteTablet for 3 replicas of tablet ced4228b86424716b6de60058d7d16a9
I20260811 18:57:47.791229 8998 tablet_service.cc:1514] Processing DeleteTablet for tablet ced4228b86424716b6de60058d7d16a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:47 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:44006
I20260811 18:57:47.791231 8714 tablet_service.cc:1514] Processing DeleteTablet for tablet ced4228b86424716b6de60058d7d16a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:47 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:49958
I20260811 18:57:47.791347 9215 tablet_replica.cc:330] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003: stopping tablet replica
I20260811 18:57:47.791353 9213 tablet_replica.cc:330] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade: stopping tablet replica
I20260811 18:57:47.791414 9213 raft_consensus.cc:2229] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:47.791414 9215 raft_consensus.cc:2229] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:57:47.791402 8445 tablet_service.cc:1514] Processing DeleteTablet for tablet ced4228b86424716b6de60058d7d16a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:47 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:36582
I20260811 18:57:47.791456 9213 raft_consensus.cc:2258] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:47.791481 9214 tablet_replica.cc:330] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c: stopping tablet replica
I20260811 18:57:47.791503 9215 raft_consensus.cc:2258] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:47.791519 9214 raft_consensus.cc:2229] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:47.791549 9214 raft_consensus.cc:2258] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:47.791823 9213 ts_tablet_manager.cc:1905] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:47.791865 9214 ts_tablet_manager.cc:1905] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:47.793702 9214 ts_tablet_manager.cc:1918] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:57:47.793768 9214 log.cc:1196] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-0/wal/wals/ced4228b86424716b6de60058d7d16a9
I20260811 18:57:47.793766 9215 ts_tablet_manager.cc:1905] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:47.793991 9214 ts_tablet_manager.cc:1939] T ced4228b86424716b6de60058d7d16a9 P 3fb258169825437ea54960dea7c12e2c: Deleting consensus metadata
I20260811 18:57:47.794358 8151 catalog_manager.cc:4841] TS 3fb258169825437ea54960dea7c12e2c (127.5.226.65:37061): tablet ced4228b86424716b6de60058d7d16a9 (table test-table [id=895a74e6ef5e45919a2b15a8c8fb53c7]) successfully deleted
I20260811 18:57:47.795267 9215 ts_tablet_manager.cc:1918] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:57:47.795333 9215 log.cc:1196] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/ced4228b86424716b6de60058d7d16a9
I20260811 18:57:47.795531 9215 ts_tablet_manager.cc:1939] T ced4228b86424716b6de60058d7d16a9 P f3df3d61fa754539b9d95d0362d9b003: Deleting consensus metadata
I20260811 18:57:47.795740 9213 ts_tablet_manager.cc:1918] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:57:47.795799 9213 log.cc:1196] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/ced4228b86424716b6de60058d7d16a9
I20260811 18:57:47.796025 9213 ts_tablet_manager.cc:1939] T ced4228b86424716b6de60058d7d16a9 P 74651d1e9bc0400cbc8bb64069246ade: Deleting consensus metadata
I20260811 18:57:47.796363 8151 catalog_manager.cc:4841] TS 74651d1e9bc0400cbc8bb64069246ade (127.5.226.66:45801): tablet ced4228b86424716b6de60058d7d16a9 (table test-table [id=895a74e6ef5e45919a2b15a8c8fb53c7]) successfully deleted
I20260811 18:57:47.796527 8151 catalog_manager.cc:4841] TS f3df3d61fa754539b9d95d0362d9b003 (127.5.226.67:46533): tablet ced4228b86424716b6de60058d7d16a9 (table test-table [id=895a74e6ef5e45919a2b15a8c8fb53c7]) successfully deleted
Aug 11 18:57:47 dist-test-slave-gjw7 krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474667, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.226.65@KRBTEST.COM
I20260811 18:57:47.801667 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.792088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36608 (local address 127.5.226.65:37061)
0811 18:57:47.792130 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.792132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.792249 (+ 117us) server_negotiation.cc:407] Connection header received
0811 18:57:47.792331 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.792332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.792343 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.792371 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:47.793007 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.793731 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.794906 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.795202 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.795294 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.798913 (+ 3619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:47.798925 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:47.798926 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:47.798934 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:47.800474 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.800825 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.800828 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.800829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.800890 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.801074 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.801075 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.801075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.801227 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:47.801393 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.801473 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.801559 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 18:57:47.801968 8561 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36608
I20260811 18:57:47.808646 8314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:47.803015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34014 (local address 127.5.226.126:35463)
0811 18:57:47.803066 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:47.803068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:47.803077 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:57:47.803143 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:47.803144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:47.803197 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:47.803247 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:47.803728 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.804223 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.804892 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:47.805085 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:47.805141 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:47.806250 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:47.806251 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:47.806252 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:47.806260 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:47.807576 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.807911 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.807912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.807912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.807966 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:47.808142 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:47.808143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:47.808143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:47.808263 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:47.808361 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:47.808474 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 18:57:47.808555 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 18:57:47.809041 8183 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34014
I20260811 18:57:47.809958 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 8323
I20260811 18:57:47.819905 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 8591
I20260811 18:57:47.831022 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 8863
I20260811 18:57:47.847573 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 8122
2026-08-11T18:57:47Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2387 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:47 dist-test-slave-gjw7 krb5kdc[9280](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:47 dist-test-slave-gjw7 krb5kdc[9280](info): set up 2 sockets
Aug 11 18:57:47 dist-test-slave-gjw7 krb5kdc[9280](info): commencing operation
krb5kdc: starting...
W20260811 18:57:49.060530 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:57:49 dist-test-slave-gjw7 krb5kdc[9280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 18:57:49.177824 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:34351
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:34917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:34351
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:49.259378 9311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:49.259583 9311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:49.259604 9311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:49.260675 9311 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:49.260706 9311 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 18:57:49.260718 9311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:49.260730 9311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:49.260740 9311 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:49.260756 9311 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:49.262171 9311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:34351
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:34351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:49.262367 9311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:49.262537 9311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:49.267168 9319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:49.267313 9311 server_base.cc:1034] running on GCE node
W20260811 18:57:49.267212 9318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:49.267174 9327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:49.267668 9311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:49.267957 9311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:49.269104 9311 hybrid_clock.cc:648] HybridClock initialized: now 1786474669269084 us; error 33 us; skew 500 ppm
Aug 11 18:57:49 dist-test-slave-gjw7 krb5kdc[9280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474669, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:49.271517 9311 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 18:57:49.271934 9311 webserver.cc:460] Webserver started at http://127.5.226.126:40425/ using document root <none> and password file <none>
I20260811 18:57:49.272146 9311 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:49.272194 9311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:49.272459 9311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:49.273578 9311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "93732167cce947ff86de2c1206f4d335"
format_stamp: "Formatted at 2026-08-11 18:57:49 on dist-test-slave-gjw7"
server_key: "cf38632ef7a88e6d93852c736655a53b"
server_key_iv: "570856143cec1af96d3a3b5695fa4727"
server_key_version: "encryptionkey@0"
I20260811 18:57:49.273926 9311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "93732167cce947ff86de2c1206f4d335"
format_stamp: "Formatted at 2026-08-11 18:57:49 on dist-test-slave-gjw7"
server_key: "cf38632ef7a88e6d93852c736655a53b"
server_key_iv: "570856143cec1af96d3a3b5695fa4727"
server_key_version: "encryptionkey@0"
I20260811 18:57:49.275188 9311 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:57:49.275866 9343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:49.276026 9311 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:49.276109 9311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "93732167cce947ff86de2c1206f4d335"
format_stamp: "Formatted at 2026-08-11 18:57:49 on dist-test-slave-gjw7"
server_key: "cf38632ef7a88e6d93852c736655a53b"
server_key_iv: "570856143cec1af96d3a3b5695fa4727"
server_key_version: "encryptionkey@0"
I20260811 18:57:49.276168 9311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:49.298022 9311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:49.299741 9311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:49.299875 9311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:49.304440 9311 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:34351
I20260811 18:57:49.304522 9461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:34351 every 8 connection(s)
I20260811 18:57:49.304814 9311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:49.305516 9462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:49.307828 9462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335: Bootstrap starting.
I20260811 18:57:49.308422 9462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:49.308691 9462 log.cc:824] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:49.309401 9462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335: No bootstrap required, opened a new log
I20260811 18:57:49.311523 9462 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93732167cce947ff86de2c1206f4d335" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34351 } }
I20260811 18:57:49.311668 9462 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:49.311690 9462 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93732167cce947ff86de2c1206f4d335, State: Initialized, Role: FOLLOWER
I20260811 18:57:49.311854 9462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93732167cce947ff86de2c1206f4d335" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34351 } }
I20260811 18:57:49.311923 9462 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:49.311946 9462 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:49.311993 9462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:49.312515 9462 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93732167cce947ff86de2c1206f4d335" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34351 } }
I20260811 18:57:49.312609 9462 leader_election.cc:302] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93732167cce947ff86de2c1206f4d335; no voters:
I20260811 18:57:49.312736 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 9311
I20260811 18:57:49.312775 9462 leader_election.cc:288] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:49.312824 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:57:49.312819 9465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:49.312943 9465 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [term 1 LEADER]: Becoming Leader. State: Replica: 93732167cce947ff86de2c1206f4d335, State: Running, Role: LEADER
I20260811 18:57:49.313023 6025 external_mini_cluster.cc:1428] Setting key e5124904dd82a447b9af06594c7f8f11
I20260811 18:57:49.313084 9462 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:49.313078 9465 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93732167cce947ff86de2c1206f4d335" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34351 } }
I20260811 18:57:49.314505 9466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93732167cce947ff86de2c1206f4d335" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93732167cce947ff86de2c1206f4d335" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34351 } } }
I20260811 18:57:49.314559 9467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93732167cce947ff86de2c1206f4d335. Latest consensus state: current_term: 1 leader_uuid: "93732167cce947ff86de2c1206f4d335" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93732167cce947ff86de2c1206f4d335" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34351 } } }
I20260811 18:57:49.314745 9466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:49.314754 9467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335 [sys.catalog]: This master's current role is: LEADER
W20260811 18:57:49.315213 9492 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:57:49.315267 9492 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:57:49.315397 9494 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:49.315567 9494 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:49.317165 9494 catalog_manager.cc:1347] Generated new cluster ID: d0ca612726264b688778b68229ccc2b7
I20260811 18:57:49.317229 9494 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:57:49 dist-test-slave-gjw7 krb5kdc[9280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:49.325704 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.313616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39402 (local address 127.5.226.126:34351)
0811 18:57:49.314057 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:49.314068 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:49.314622 (+ 554us) server_negotiation.cc:407] Connection header received
0811 18:57:49.315030 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:49.315039 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:49.315094 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:49.315222 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:49.315974 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.317220 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.318387 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.318987 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.319411 (+ 424us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.322001 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:49.322005 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:49.322005 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:49.322020 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:49.324000 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.324407 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.324409 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.324409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.324515 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.324721 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.324722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.324722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.325013 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:49.325174 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:49.325269 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 18:57:49.325446 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":89,"threads_started":1}
I20260811 18:57:49.326753 9494 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:49.327244 9494 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:49.333995 9494 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335: Generated new TSK 0
I20260811 18:57:49.334170 9494 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 18:57:49.362179 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:34351
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:34917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:49.445062 9503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:49.445271 9503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:49.445317 9503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:49.446488 9503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:49.446533 9503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:49.446552 9503 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 18:57:49.446563 9503 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:57:49.446578 9503 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:57:49.448087 9503 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.226.126:34351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9503
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:49.448339 9503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:49.448558 9503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:49.453362 9523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:49.453472 9520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:49.453361 9514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:49.453588 9503 server_base.cc:1034] running on GCE node
I20260811 18:57:49.453814 9503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:49.454030 9503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:49.455192 9503 hybrid_clock.cc:648] HybridClock initialized: now 1786474669455153 us; error 29 us; skew 500 ppm
Aug 11 18:57:49 dist-test-slave-gjw7 krb5kdc[9280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474669, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:49.457571 9503 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 18:57:49.457978 9503 webserver.cc:460] Webserver started at http://127.5.226.65:39701/ using document root <none> and password file <none>
I20260811 18:57:49.458178 9503 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:49.458221 9503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:49.458338 9503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:49.459368 9503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "6991f49b0d5a48b08ad92795be6d8802"
format_stamp: "Formatted at 2026-08-11 18:57:49 on dist-test-slave-gjw7"
server_key: "834a36a09b155b83263360995fed3101"
server_key_iv: "ddb90dabae6416b2fec5fbe01f72ee67"
server_key_version: "encryptionkey@0"
I20260811 18:57:49.459700 9503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "6991f49b0d5a48b08ad92795be6d8802"
format_stamp: "Formatted at 2026-08-11 18:57:49 on dist-test-slave-gjw7"
server_key: "834a36a09b155b83263360995fed3101"
server_key_iv: "ddb90dabae6416b2fec5fbe01f72ee67"
server_key_version: "encryptionkey@0"
I20260811 18:57:49.461054 9503 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:49.461884 9543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:49.462031 9503 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:49.462126 9503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "6991f49b0d5a48b08ad92795be6d8802"
format_stamp: "Formatted at 2026-08-11 18:57:49 on dist-test-slave-gjw7"
server_key: "834a36a09b155b83263360995fed3101"
server_key_iv: "ddb90dabae6416b2fec5fbe01f72ee67"
server_key_version: "encryptionkey@0"
I20260811 18:57:49.462219 9503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:49.476087 9503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:49.478107 9503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:49.478266 9503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:49.478854 9503 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:49.478899 9503 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:49.478933 9503 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:49.478969 9503 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:57:49 dist-test-slave-gjw7 krb5kdc[9280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474669, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:49.486465 9503 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:36777
I20260811 18:57:49.486758 9745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:36777 every 8 connection(s)
I20260811 18:57:49.486822 9503 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 18:57:49.487957 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 9503
I20260811 18:57:49.488059 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:57:49.488230 6025 external_mini_cluster.cc:1428] Setting key a9601c8ab13f71a90c194ab375c71b2b
I20260811 18:57:49.488715 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.479280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:50779 (local address 127.5.226.126:34351)
0811 18:57:49.479373 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:49.479376 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:49.479552 (+ 176us) server_negotiation.cc:407] Connection header received
0811 18:57:49.480140 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:49.480141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:49.480156 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:49.480251 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:49.481095 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.481878 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.482931 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.483143 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.483202 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.485823 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:49.485825 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:49.485825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:49.485834 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:49.487278 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.487649 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.487651 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.487651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.487712 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.487984 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.487985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.487985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.488184 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:49.488257 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:49.488559 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 18:57:49.488649 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 18:57:49.488907 9556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.479242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:34351 (local address 127.5.226.65:50779)
0811 18:57:49.479429 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:49.479469 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:49.480041 (+ 572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:49.480317 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:49.480322 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:49.480716 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:49.480991 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.481000 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.481986 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.481987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.482845 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.482847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.483218 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.483219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.483357 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.483828 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:49.483848 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:49.485729 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:49.487359 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:49.487364 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:49.487366 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:49.487585 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:49.487765 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:49.487766 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:49.487767 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:49.487906 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:49.488257 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:49.488266 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:49.488438 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 18:57:49.488525 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:57:49.488691 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":113,"threads_started":1}
I20260811 18:57:49.489436 9747 heartbeater.cc:347] Connected to a master server at 127.5.226.126:34351
I20260811 18:57:49.489534 9747 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:49.489741 9747 heartbeater.cc:511] Master 127.5.226.126:34351 requested a full tablet report, sending...
I20260811 18:57:49.490307 9374 ts_manager.cc:194] Registered new tserver with Master: 6991f49b0d5a48b08ad92795be6d8802 (127.5.226.65:36777)
I20260811 18:57:49.491173 9374 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:50779
I20260811 18:57:49.496196 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.490559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:59249 (local address 127.5.226.126:34351)
0811 18:57:49.490598 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:49.490600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:49.490852 (+ 252us) server_negotiation.cc:407] Connection header received
0811 18:57:49.490930 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:49.490931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:49.490945 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:49.490995 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:49.491383 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.492044 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.492703 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.492917 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.492982 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.493897 (+ 915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:49.493898 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:49.493899 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:49.493906 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:49.495133 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.495458 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.495459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.495460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.495517 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.495702 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.495703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.495704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.495813 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:49.495872 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:49.496027 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 18:57:49.496104 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:57:49.496215 9762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.490633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:34351 (local address 127.5.226.65:59249)
0811 18:57:49.490785 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:49.490795 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:49.490860 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:49.491023 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:49.491024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:49.491233 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:49.491305 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.491308 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.492117 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.492119 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.492614 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.492615 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.492988 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.492989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.493076 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.493525 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:49.493530 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:49.493811 (+ 281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:49.495215 (+ 1404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:49.495215 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:49.495216 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:49.495384 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:49.495573 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:49.495574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:49.495574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:49.495637 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:49.495870 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:49.495871 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:49.495930 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 18:57:49.495997 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 18:57:49.496105 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":89,"threads_started":1}
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 18:57:49.513883 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:34351
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:34917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:49.596920 9770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:49.597127 9770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:49.597157 9770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:49.598294 9770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:49.598341 9770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:49.598368 9770 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 18:57:49.598383 9770 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:57:49.598407 9770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:57:49.599912 9770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.226.126:34351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:49.600154 9770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:49.600378 9770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:49.605484 9780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:49.605489 9783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:49.605604 9770 server_base.cc:1034] running on GCE node
W20260811 18:57:49.605500 9788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:49.605856 9770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:49.606091 9770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:49.607228 9770 hybrid_clock.cc:648] HybridClock initialized: now 1786474669607215 us; error 29 us; skew 500 ppm
Aug 11 18:57:49 dist-test-slave-gjw7 krb5kdc[9280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474669, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:49.609678 9770 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 18:57:49.610095 9770 webserver.cc:460] Webserver started at http://127.5.226.66:42063/ using document root <none> and password file <none>
I20260811 18:57:49.610280 9770 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:49.610323 9770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:49.610417 9770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:49.611393 9770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "5683b6aba5124fd2baaad86d5d0bd248"
format_stamp: "Formatted at 2026-08-11 18:57:49 on dist-test-slave-gjw7"
server_key: "57d7d7e5fec4567ae96d9d49c8449d93"
server_key_iv: "1326dbf3e11f36eec4c5388f1a9a0d0c"
server_key_version: "encryptionkey@0"
I20260811 18:57:49.611692 9770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "5683b6aba5124fd2baaad86d5d0bd248"
format_stamp: "Formatted at 2026-08-11 18:57:49 on dist-test-slave-gjw7"
server_key: "57d7d7e5fec4567ae96d9d49c8449d93"
server_key_iv: "1326dbf3e11f36eec4c5388f1a9a0d0c"
server_key_version: "encryptionkey@0"
I20260811 18:57:49.612960 9770 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:57:49.613695 9811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:49.613874 9770 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:49.613965 9770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "5683b6aba5124fd2baaad86d5d0bd248"
format_stamp: "Formatted at 2026-08-11 18:57:49 on dist-test-slave-gjw7"
server_key: "57d7d7e5fec4567ae96d9d49c8449d93"
server_key_iv: "1326dbf3e11f36eec4c5388f1a9a0d0c"
server_key_version: "encryptionkey@0"
I20260811 18:57:49.614030 9770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:49.637439 9770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:49.639688 9770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:49.639816 9770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:49.640409 9770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:49.640453 9770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:49.640476 9770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:49.640487 9770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:57:49 dist-test-slave-gjw7 krb5kdc[9280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474669, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:49.647775 9770 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:40343
I20260811 18:57:49.647878 10057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:40343 every 8 connection(s)
I20260811 18:57:49.648200 9770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 18:57:49.649503 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 9770
I20260811 18:57:49.649597 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:57:49.649791 6025 external_mini_cluster.cc:1428] Setting key 7dfdfdcfd4ee7c50c347b763e26eb7b9
I20260811 18:57:49.650732 9823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.640833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:34351 (local address 127.5.226.66:39273)
0811 18:57:49.641013 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:49.641063 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:49.641758 (+ 695us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:49.642105 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:49.642110 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:49.642477 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:49.642780 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.642789 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.643478 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.643480 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.644784 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.644788 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.645201 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.645202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.645357 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.645857 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:49.645868 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:49.647458 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:49.649175 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:49.649180 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:49.649181 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:49.649501 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:49.649714 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:49.649715 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:49.649715 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:49.649856 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:49.650151 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:49.650160 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:49.650294 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 18:57:49.650398 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 18:57:49.650565 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":93,"threads_started":1}
I20260811 18:57:49.651059 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.640860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:39273 (local address 127.5.226.126:34351)
0811 18:57:49.640932 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:49.640934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:49.641172 (+ 238us) server_negotiation.cc:407] Connection header received
0811 18:57:49.641928 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:49.641929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:49.641944 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:49.642000 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:49.642896 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.643404 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.644884 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.645099 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.645163 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.647553 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:49.647555 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:49.647555 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:49.647564 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:49.649105 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.649577 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.649577 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.649578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.649644 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.649946 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.649947 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.649948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.650097 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:49.650158 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:49.650885 (+ 727us) server_negotiation.cc:299] Negotiation successful
0811 18:57:49.650968 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 18:57:49.652417 10058 heartbeater.cc:347] Connected to a master server at 127.5.226.126:34351
I20260811 18:57:49.652501 10058 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:49.652659 10058 heartbeater.cc:511] Master 127.5.226.126:34351 requested a full tablet report, sending...
I20260811 18:57:49.653043 9374 ts_manager.cc:194] Registered new tserver with Master: 5683b6aba5124fd2baaad86d5d0bd248 (127.5.226.66:40343)
I20260811 18:57:49.653479 9374 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:39273
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
I20260811 18:57:49.659317 10067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.652957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:34351 (local address 127.5.226.66:33493)
0811 18:57:49.653728 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:49.653738 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:49.653810 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:49.653956 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:49.653957 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:49.654159 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:49.654227 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.654229 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.655087 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.655088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.655582 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.655583 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.656038 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.656038 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.656092 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.656507 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:49.656511 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:49.656783 (+ 272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:49.658366 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:49.658367 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:49.658367 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:49.658531 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:49.658719 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:49.658719 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:49.658719 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:49.658768 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:49.659093 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:49.659093 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:49.659131 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 18:57:49.659174 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 18:57:49.659251 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"thread_start_us":99,"threads_started":1}
I20260811 18:57:49.659364 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.653001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:33493 (local address 127.5.226.126:34351)
0811 18:57:49.653050 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:49.653052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:49.653782 (+ 730us) server_negotiation.cc:407] Connection header received
0811 18:57:49.653876 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:49.653877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:49.653888 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:49.653945 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:49.654303 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.655012 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.655657 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.655969 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.656042 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.656866 (+ 824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:49.656867 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:49.656867 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:49.656875 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:49.658294 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.658598 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.658599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.658600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.658659 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.658832 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.658833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.658833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.659029 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:49.659102 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:49.659201 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 18:57:49.659275 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 18:57:49.676214 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:34351
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:34917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:49.757931 10073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:49.758141 10073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:49.758167 10073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:49.759261 10073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:49.759302 10073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:49.759321 10073 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 18:57:49.759332 10073 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:57:49.759346 10073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:57:49.760730 10073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.226.126:34351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:49.760927 10073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:49.761107 10073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:49.766052 10083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:49.766076 10087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:49.766065 10082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:49.766299 10073 server_base.cc:1034] running on GCE node
I20260811 18:57:49.766497 10073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:49.766717 10073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:49.767859 10073 hybrid_clock.cc:648] HybridClock initialized: now 1786474669767847 us; error 34 us; skew 500 ppm
Aug 11 18:57:49 dist-test-slave-gjw7 krb5kdc[9280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474669, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:49.770264 10073 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 18:57:49.770694 10073 webserver.cc:460] Webserver started at http://127.5.226.67:44279/ using document root <none> and password file <none>
I20260811 18:57:49.770900 10073 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:49.770948 10073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:49.771075 10073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:49.772127 10073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "f886638c6cad4826bb3b426ee1c73249"
format_stamp: "Formatted at 2026-08-11 18:57:49 on dist-test-slave-gjw7"
server_key: "ee9283b00761ec3472b93cf5fb54102d"
server_key_iv: "eaa17d21a99fc2ba5e12c4d0e3ff970d"
server_key_version: "encryptionkey@0"
I20260811 18:57:49.772462 10073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "f886638c6cad4826bb3b426ee1c73249"
format_stamp: "Formatted at 2026-08-11 18:57:49 on dist-test-slave-gjw7"
server_key: "ee9283b00761ec3472b93cf5fb54102d"
server_key_iv: "eaa17d21a99fc2ba5e12c4d0e3ff970d"
server_key_version: "encryptionkey@0"
I20260811 18:57:49.773757 10073 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:49.774435 10101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:49.774593 10073 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:49.774680 10073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "f886638c6cad4826bb3b426ee1c73249"
format_stamp: "Formatted at 2026-08-11 18:57:49 on dist-test-slave-gjw7"
server_key: "ee9283b00761ec3472b93cf5fb54102d"
server_key_iv: "eaa17d21a99fc2ba5e12c4d0e3ff970d"
server_key_version: "encryptionkey@0"
I20260811 18:57:49.774739 10073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:49.782677 10073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:49.784741 10073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:49.784879 10073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:49.785393 10073 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:49.785439 10073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:49.785466 10073 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:49.785490 10073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:57:49 dist-test-slave-gjw7 krb5kdc[9280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474669, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:49.792176 10073 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:41839
I20260811 18:57:49.792246 10349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:41839 every 8 connection(s)
I20260811 18:57:49.792553 10073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 18:57:49.794667 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.785839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:60911 (local address 127.5.226.126:34351)
0811 18:57:49.785894 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:49.785896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:49.786116 (+ 220us) server_negotiation.cc:407] Connection header received
0811 18:57:49.786651 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:49.786652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:49.786667 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:49.786743 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:49.787554 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.788312 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.789374 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.789666 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.789742 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.792216 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:49.792217 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:49.792218 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:49.792226 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:49.793611 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.793966 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.793967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.793967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.794013 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.794173 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.794173 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.794173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.794266 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:49.794328 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:49.794541 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 18:57:49.794604 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 18:57:49.794833 10122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.785846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:34351 (local address 127.5.226.67:60911)
0811 18:57:49.785993 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:49.786030 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:49.786548 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:49.786813 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:49.786816 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:49.787154 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:49.787440 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.787449 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.788426 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.788427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.789252 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.789255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.789772 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.789773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.789891 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.790377 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:49.790397 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:49.792121 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:49.793682 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:49.793691 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:49.793692 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:49.793907 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:49.794049 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:49.794050 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:49.794050 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:49.794134 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:49.794326 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:49.794329 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:49.794437 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 18:57:49.794515 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 18:57:49.794633 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":84,"threads_started":1}
I20260811 18:57:49.795326 10352 heartbeater.cc:347] Connected to a master server at 127.5.226.126:34351
I20260811 18:57:49.795411 10352 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:49.795599 10352 heartbeater.cc:511] Master 127.5.226.126:34351 requested a full tablet report, sending...
I20260811 18:57:49.796015 9371 ts_manager.cc:194] Registered new tserver with Master: f886638c6cad4826bb3b426ee1c73249 (127.5.226.67:41839)
I20260811 18:57:49.796476 9371 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:60911
I20260811 18:57:49.801098 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.796355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:34041 (local address 127.5.226.126:34351)
0811 18:57:49.796604 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:49.796606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:49.796614 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:57:49.796632 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:49.796632 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:49.796641 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:49.796687 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:49.797029 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.797556 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.798181 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.798363 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.798405 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.799110 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:49.799111 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:49.799111 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:49.799116 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:49.800295 (+ 1179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.800580 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.800581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.800581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.800624 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.800743 (+ 119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.800744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.800744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.800843 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:49.800904 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:49.800986 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 18:57:49.801041 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230}
I20260811 18:57:49.801100 10366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.796280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:34351 (local address 127.5.226.67:34041)
0811 18:57:49.796408 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:49.796419 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:49.796470 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:49.796719 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:49.796720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:49.796903 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:49.796958 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.796961 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.797647 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.797648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.798128 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.798129 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.798410 (+ 281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.798411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.798463 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.798791 (+ 328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:49.798795 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:49.799046 (+ 251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:49.800369 (+ 1323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:49.800370 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:49.800371 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:49.800527 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:49.800664 (+ 137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:49.800665 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:49.800665 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:49.800711 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:49.800891 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:49.800892 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:49.800925 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 18:57:49.800968 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 18:57:49.801039 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":71,"threads_started":1}
I20260811 18:57:49.801482 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 10073
I20260811 18:57:49.801575 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:57:49.801761 6025 external_mini_cluster.cc:1428] Setting key c4b8a99a2d4bc61e589316dfd17e3a07
I20260811 18:57:49.802659 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:57:49 dist-test-slave-gjw7 krb5kdc[9280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:57:49 dist-test-slave-gjw7 krb5kdc[9280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:49.826457 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.819805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48402 (local address 127.5.226.126:34351)
0811 18:57:49.819863 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:49.819865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:49.819894 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:57:49.819919 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:49.819920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:49.819929 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:49.819967 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:49.820513 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.821021 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.821835 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.822026 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.822079 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.824276 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:49.824277 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:49.824277 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:49.824284 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:49.825521 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.825850 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.825851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.825851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.825918 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.826057 (+ 139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.826058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.826058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.826161 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:49.826251 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:49.826324 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 18:57:49.826388 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 18:57:49.827916 9371 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48402:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:57:49.829442 9371 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:49.835464 10385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.831632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58078 (local address 127.5.226.65:36777)
0811 18:57:49.831917 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:49.831920 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:49.831930 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:57:49.831969 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:49.831971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:49.831987 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:49.832061 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:49.832199 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.833275 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.834554 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.835053 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.835116 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.835190 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:49.835324 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 18:57:49.835366 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":74,"threads_started":1}
I20260811 18:57:49.835456 10378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.831384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:36777 (local address 127.0.0.1:58078)
0811 18:57:49.831759 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:49.831770 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:49.831825 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:49.832070 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:49.832071 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:49.832073 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:49.832114 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.832116 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.833417 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.833418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.834495 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.834497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.835130 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.835131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.835209 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.835224 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 18:57:49.835295 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 18:57:49.835350 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":4,"thread_start_us":53,"threads_started":1}
I20260811 18:57:49.835597 10377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.831388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:41839 (local address 127.0.0.1:50714)
0811 18:57:49.831889 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:49.831896 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:49.831936 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:49.832234 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:49.832235 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:49.832237 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:49.832293 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.832295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.833119 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.833120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.834398 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.834401 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.835317 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.835318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.835370 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.835374 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:49.835413 (+ 39us) client_negotiation.cc:240] Negotiation successful
0811 18:57:49.835447 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":4,"thread_start_us":73,"threads_started":1}
I20260811 18:57:49.835638 10384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.831586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42972 (local address 127.5.226.66:40343)
0811 18:57:49.831816 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:49.831819 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:49.831827 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:57:49.831860 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:49.831861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:49.831873 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:49.831941 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:49.832111 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.833275 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.834296 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.835054 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.835121 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.835181 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:49.835500 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 18:57:49.835537 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":110,"threads_started":1}
I20260811 18:57:49.835634 10382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.831561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50714 (local address 127.5.226.67:41839)
0811 18:57:49.831835 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:49.831840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:49.831978 (+ 138us) server_negotiation.cc:407] Connection header received
0811 18:57:49.832019 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:49.832021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:49.832034 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:49.832164 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:49.832369 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.833040 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.834479 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.835175 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.835232 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.835285 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:49.835499 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 18:57:49.835539 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":106,"threads_started":1}
I20260811 18:57:49.835945 10381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.831384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:40343 (local address 127.0.0.1:42972)
0811 18:57:49.831550 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:49.831592 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:49.831667 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:49.831955 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:49.831958 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:49.831960 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:49.832029 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.832032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.833384 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.833385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.834195 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.834198 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.835230 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.835231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.835307 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.835312 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:57:49.835357 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 18:57:49.835397 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":57,"threads_started":1}
I20260811 18:57:49.836413 10212 tablet_service.cc:1467] Processing CreateTablet for tablet 45e475e690674cf98992d592a2f00138 (DEFAULT_TABLE table=test-table [id=3c900dcfd5d14f11ad04ea1dfe88ac50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:49.836586 9629 tablet_service.cc:1467] Processing CreateTablet for tablet 45e475e690674cf98992d592a2f00138 (DEFAULT_TABLE table=test-table [id=3c900dcfd5d14f11ad04ea1dfe88ac50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:49.836643 9916 tablet_service.cc:1467] Processing CreateTablet for tablet 45e475e690674cf98992d592a2f00138 (DEFAULT_TABLE table=test-table [id=3c900dcfd5d14f11ad04ea1dfe88ac50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:49.836807 10212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45e475e690674cf98992d592a2f00138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:49.836855 9629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45e475e690674cf98992d592a2f00138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:49.836946 9916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45e475e690674cf98992d592a2f00138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:49.839660 10387 tablet_bootstrap.cc:492] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802: Bootstrap starting.
I20260811 18:57:49.840094 10389 tablet_bootstrap.cc:492] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249: Bootstrap starting.
I20260811 18:57:49.840337 10392 tablet_bootstrap.cc:492] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248: Bootstrap starting.
I20260811 18:57:49.840813 10387 tablet_bootstrap.cc:654] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:49.840880 10392 tablet_bootstrap.cc:654] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:49.841070 10389 tablet_bootstrap.cc:654] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:49.841156 10387 log.cc:824] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:49.841203 10392 log.cc:824] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:49.841434 10389 log.cc:824] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:49.841965 10392 tablet_bootstrap.cc:492] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248: No bootstrap required, opened a new log
I20260811 18:57:49.842028 10392 ts_tablet_manager.cc:1397] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:57:49.842077 10387 tablet_bootstrap.cc:492] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802: No bootstrap required, opened a new log
I20260811 18:57:49.842104 10389 tablet_bootstrap.cc:492] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249: No bootstrap required, opened a new log
I20260811 18:57:49.842157 10389 ts_tablet_manager.cc:1397] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:57:49.842187 10387 ts_tablet_manager.cc:1397] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:57:49.843405 10392 raft_consensus.cc:348] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } }
I20260811 18:57:49.843537 10392 raft_consensus.cc:374] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:49.843569 10392 raft_consensus.cc:729] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5683b6aba5124fd2baaad86d5d0bd248, State: Initialized, Role: FOLLOWER
I20260811 18:57:49.843703 10392 consensus_queue.cc:260] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } }
I20260811 18:57:49.844015 10392 ts_tablet_manager.cc:1428] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:57:49.844136 10058 heartbeater.cc:503] Master 127.5.226.126:34351 was elected leader, sending a full tablet report...
I20260811 18:57:49.844102 10387 raft_consensus.cc:348] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } }
I20260811 18:57:49.844167 10389 raft_consensus.cc:348] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } }
I20260811 18:57:49.844271 10387 raft_consensus.cc:374] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:49.844293 10389 raft_consensus.cc:374] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:49.844328 10389 raft_consensus.cc:729] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f886638c6cad4826bb3b426ee1c73249, State: Initialized, Role: FOLLOWER
I20260811 18:57:49.844355 10387 raft_consensus.cc:729] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6991f49b0d5a48b08ad92795be6d8802, State: Initialized, Role: FOLLOWER
I20260811 18:57:49.844444 10389 consensus_queue.cc:260] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } }
I20260811 18:57:49.844461 10387 consensus_queue.cc:260] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } }
I20260811 18:57:49.844710 10387 ts_tablet_manager.cc:1428] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:57:49.844710 10389 ts_tablet_manager.cc:1428] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:57:49.844835 9747 heartbeater.cc:503] Master 127.5.226.126:34351 was elected leader, sending a full tablet report...
I20260811 18:57:49.844856 10352 heartbeater.cc:503] Master 127.5.226.126:34351 was elected leader, sending a full tablet report...
I20260811 18:57:49.856719 10404 raft_consensus.cc:482] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:49.856815 10404 raft_consensus.cc:504] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } }
I20260811 18:57:49.857131 10404 leader_election.cc:288] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5683b6aba5124fd2baaad86d5d0bd248 (127.5.226.66:40343), 6991f49b0d5a48b08ad92795be6d8802 (127.5.226.65:36777)
I20260811 18:57:49.860740 10385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.857425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:48681 (local address 127.5.226.65:36777)
0811 18:57:49.857462 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:49.857463 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:49.857540 (+ 77us) server_negotiation.cc:407] Connection header received
0811 18:57:49.857593 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:49.857594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:49.857602 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:49.857635 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:49.857764 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.858458 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.859846 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.860405 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.860473 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.860481 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:49.860636 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 18:57:49.860671 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:57:49.860740 10384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.857368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:44813 (local address 127.5.226.66:40343)
0811 18:57:49.857420 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:49.857422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:49.857430 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:57:49.857456 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:49.857457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:49.857467 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:49.857522 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:49.857671 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.858414 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.859846 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.860405 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.860473 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.860481 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:49.860639 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 18:57:49.860670 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 18:57:49.860781 10122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.857304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:40343 (local address 127.5.226.67:44813)
0811 18:57:49.857341 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:49.857352 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:49.857393 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:49.857540 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:49.857541 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:49.857543 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:49.857611 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.857612 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.858488 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.858489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.859767 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.859770 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.860485 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.860486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.860582 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.860585 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:57:49.860631 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 18:57:49.860676 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16,"mutex_wait_us":75}
I20260811 18:57:49.861104 9970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45e475e690674cf98992d592a2f00138" candidate_uuid: "f886638c6cad4826bb3b426ee1c73249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5683b6aba5124fd2baaad86d5d0bd248" is_pre_election: true
I20260811 18:57:49.860786 10405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.857311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:36777 (local address 127.5.226.67:48681)
0811 18:57:49.857485 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:49.857493 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:49.857539 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:49.857651 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:49.857651 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:49.857653 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:49.857712 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.857713 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.858523 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.858524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.859767 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.859770 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.860485 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.860486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.860568 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.860572 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:49.860627 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 18:57:49.860676 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":48,"thread_start_us":88,"threads_started":1}
I20260811 18:57:49.861245 9970 raft_consensus.cc:2454] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f886638c6cad4826bb3b426ee1c73249 in term 0.
I20260811 18:57:49.861500 10112 leader_election.cc:302] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5683b6aba5124fd2baaad86d5d0bd248, f886638c6cad4826bb3b426ee1c73249; no voters:
I20260811 18:57:49.861472 9675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45e475e690674cf98992d592a2f00138" candidate_uuid: "f886638c6cad4826bb3b426ee1c73249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6991f49b0d5a48b08ad92795be6d8802" is_pre_election: true
I20260811 18:57:49.861616 9675 raft_consensus.cc:2454] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f886638c6cad4826bb3b426ee1c73249 in term 0.
I20260811 18:57:49.861620 10404 raft_consensus.cc:2781] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:49.861682 10404 raft_consensus.cc:482] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:49.861712 10404 raft_consensus.cc:3037] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:49.862385 10404 raft_consensus.cc:504] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } }
I20260811 18:57:49.862501 10404 leader_election.cc:288] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [CANDIDATE]: Term 1 election: Requested vote from peers 5683b6aba5124fd2baaad86d5d0bd248 (127.5.226.66:40343), 6991f49b0d5a48b08ad92795be6d8802 (127.5.226.65:36777)
I20260811 18:57:49.862638 9970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45e475e690674cf98992d592a2f00138" candidate_uuid: "f886638c6cad4826bb3b426ee1c73249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5683b6aba5124fd2baaad86d5d0bd248"
I20260811 18:57:49.862676 9675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45e475e690674cf98992d592a2f00138" candidate_uuid: "f886638c6cad4826bb3b426ee1c73249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6991f49b0d5a48b08ad92795be6d8802"
I20260811 18:57:49.862711 9970 raft_consensus.cc:3037] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:49.862762 9675 raft_consensus.cc:3037] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:49.863392 9970 raft_consensus.cc:2454] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f886638c6cad4826bb3b426ee1c73249 in term 1.
I20260811 18:57:49.863451 9675 raft_consensus.cc:2454] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f886638c6cad4826bb3b426ee1c73249 in term 1.
I20260811 18:57:49.863652 10106 leader_election.cc:302] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6991f49b0d5a48b08ad92795be6d8802, f886638c6cad4826bb3b426ee1c73249; no voters:
I20260811 18:57:49.863759 10404 raft_consensus.cc:2781] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:49.863916 10404 raft_consensus.cc:686] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [term 1 LEADER]: Becoming Leader. State: Replica: f886638c6cad4826bb3b426ee1c73249, State: Running, Role: LEADER
I20260811 18:57:49.864007 10404 consensus_queue.cc:237] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } }
I20260811 18:57:49.864840 9371 catalog_manager.cc:5495] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 reported cstate change: term changed from 0 to 1, leader changed from <none> to f886638c6cad4826bb3b426ee1c73249 (127.5.226.67). New cstate: current_term: 1 leader_uuid: "f886638c6cad4826bb3b426ee1c73249" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } health_report { overall_health: UNKNOWN } } }
Aug 11 18:57:49 dist-test-slave-gjw7 krb5kdc[9280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474669, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:49.889667 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.882172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48412 (local address 127.5.226.126:34351)
0811 18:57:49.882228 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:49.882230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:49.882398 (+ 168us) server_negotiation.cc:407] Connection header received
0811 18:57:49.882462 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:49.882463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:49.882474 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:49.882532 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:49.883103 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.883750 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.884782 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.885021 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.885079 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.887474 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:49.887475 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:49.887475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:49.887483 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:49.888523 (+ 1040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.888931 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.888932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.888933 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.888991 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:49.889151 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:49.889151 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:49.889152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:49.889261 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:49.889339 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:49.889473 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 18:57:49.889565 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":25}
I20260811 18:57:49.889744 10426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:49.882137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:34351 (local address 127.0.0.1:48412)
0811 18:57:49.882311 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:49.882323 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:49.882403 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:49.882556 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:49.882556 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:49.882956 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:49.883024 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.883028 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.883847 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.883849 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.884704 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:49.884709 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:49.885088 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:49.885089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:49.885144 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:49.885744 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:49.885750 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:49.887392 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:49.888595 (+ 1203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:49.888603 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:49.888606 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:49.888867 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:49.889043 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:49.889044 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:49.889044 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:49.889103 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:49.889327 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:49.889335 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:49.889385 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 18:57:49.889446 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 18:57:49.889636 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":84,"thread_start_us":85,"threads_started":1}
I20260811 18:57:49.891523 9371 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:48412:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 18:57:49.891713 9371 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:49.893103 9629 tablet_service.cc:1467] Processing CreateTablet for tablet d1e1841f7051421a9c9b236ed6a68883 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fb7a393a04194a87bf8522d4d987f8f6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:57:49.893105 9916 tablet_service.cc:1467] Processing CreateTablet for tablet d1e1841f7051421a9c9b236ed6a68883 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fb7a393a04194a87bf8522d4d987f8f6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:57:49.893271 9629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1e1841f7051421a9c9b236ed6a68883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:49.893329 9916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1e1841f7051421a9c9b236ed6a68883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:49.893369 10212 tablet_service.cc:1467] Processing CreateTablet for tablet d1e1841f7051421a9c9b236ed6a68883 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fb7a393a04194a87bf8522d4d987f8f6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:57:49.893509 10212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1e1841f7051421a9c9b236ed6a68883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:49.894460 10387 tablet_bootstrap.cc:492] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802: Bootstrap starting.
I20260811 18:57:49.894927 10389 tablet_bootstrap.cc:492] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249: Bootstrap starting.
I20260811 18:57:49.894936 10392 tablet_bootstrap.cc:492] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248: Bootstrap starting.
I20260811 18:57:49.895099 10387 tablet_bootstrap.cc:654] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:49.895354 10389 tablet_bootstrap.cc:654] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:49.895563 10392 tablet_bootstrap.cc:654] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:49.895777 10387 tablet_bootstrap.cc:492] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802: No bootstrap required, opened a new log
I20260811 18:57:49.895826 10387 ts_tablet_manager.cc:1397] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:49.895998 10387 raft_consensus.cc:348] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:49.896080 10387 raft_consensus.cc:374] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:49.896102 10387 raft_consensus.cc:729] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6991f49b0d5a48b08ad92795be6d8802, State: Initialized, Role: FOLLOWER
I20260811 18:57:49.896150 10387 consensus_queue.cc:260] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:49.896239 10387 ts_tablet_manager.cc:1428] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:49.896347 10392 tablet_bootstrap.cc:492] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248: No bootstrap required, opened a new log
I20260811 18:57:49.896389 10392 ts_tablet_manager.cc:1397] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:49.896533 10392 raft_consensus.cc:348] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:49.896595 10392 raft_consensus.cc:374] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:49.896615 10392 raft_consensus.cc:729] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5683b6aba5124fd2baaad86d5d0bd248, State: Initialized, Role: FOLLOWER
I20260811 18:57:49.896659 10392 consensus_queue.cc:260] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:49.896674 10389 tablet_bootstrap.cc:492] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249: No bootstrap required, opened a new log
I20260811 18:57:49.896724 10389 ts_tablet_manager.cc:1397] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:57:49.896744 10392 ts_tablet_manager.cc:1428] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:49.896864 10389 raft_consensus.cc:348] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:49.896929 10389 raft_consensus.cc:374] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:49.896947 10389 raft_consensus.cc:729] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f886638c6cad4826bb3b426ee1c73249, State: Initialized, Role: FOLLOWER
I20260811 18:57:49.896904 10402 tablet_replica.cc:439] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } }
I20260811 18:57:49.896989 10402 tablet_replica.cc:442] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:57:49.896986 10389 consensus_queue.cc:260] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:49.897073 10389 ts_tablet_manager.cc:1428] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:49.897130 10401 tablet_replica.cc:439] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } }
I20260811 18:57:49.897137 10404 tablet_replica.cc:439] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } }
I20260811 18:57:49.897215 10401 tablet_replica.cc:442] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:57:49.897226 10404 tablet_replica.cc:442] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249: This TxnStatusTablet replica's current role is: FOLLOWER
W20260811 18:57:49.898749 10059 tablet.cc:2369] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:57:49.987643 9751 tablet.cc:2369] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:57:50.043146 10356 tablet.cc:2369] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:50.095394 10401 raft_consensus.cc:482] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:50.095530 10401 raft_consensus.cc:504] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:50.095955 10401 leader_election.cc:288] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6991f49b0d5a48b08ad92795be6d8802 (127.5.226.65:36777), f886638c6cad4826bb3b426ee1c73249 (127.5.226.67:41839)
I20260811 18:57:50.098865 10385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.096295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:60091 (local address 127.5.226.65:36777)
0811 18:57:50.096354 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:50.096356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:50.096365 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:57:50.096400 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:50.096401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:50.096412 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:50.096466 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:50.096647 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.097159 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.098165 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.098520 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.098576 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.098586 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:50.098751 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 18:57:50.098789 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:57:50.098871 10382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.096269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:58847 (local address 127.5.226.67:41839)
0811 18:57:50.096317 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:50.096318 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:50.096461 (+ 143us) server_negotiation.cc:407] Connection header received
0811 18:57:50.096518 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:50.096519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:50.096529 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:50.096601 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:50.096752 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.097211 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.098162 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.098539 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.098608 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.098617 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:50.098758 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 18:57:50.098792 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 18:57:50.098870 9823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.096156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:36777 (local address 127.5.226.66:60091)
0811 18:57:50.096199 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:50.096211 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:50.096255 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:50.096491 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:50.096493 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:50.096496 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:50.096578 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.096580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.097239 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.097240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.098069 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.098072 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.098594 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.098595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.098685 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.098689 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:50.098734 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 18:57:50.098781 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 18:57:50.098886 10434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.096156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:41839 (local address 127.5.226.66:58847)
0811 18:57:50.096396 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:50.096405 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:50.096460 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:50.096616 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:50.096617 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:50.096619 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:50.096691 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.096693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.097320 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.097322 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.098071 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.098073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.098643 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.098645 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.098694 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.098697 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:57:50.098745 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 18:57:50.098793 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":50,"thread_start_us":111,"threads_started":1}
I20260811 18:57:50.099134 9675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1e1841f7051421a9c9b236ed6a68883" candidate_uuid: "5683b6aba5124fd2baaad86d5d0bd248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6991f49b0d5a48b08ad92795be6d8802" is_pre_election: true
I20260811 18:57:50.099234 9675 raft_consensus.cc:2454] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5683b6aba5124fd2baaad86d5d0bd248 in term 0.
I20260811 18:57:50.099259 10255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1e1841f7051421a9c9b236ed6a68883" candidate_uuid: "5683b6aba5124fd2baaad86d5d0bd248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f886638c6cad4826bb3b426ee1c73249" is_pre_election: true
I20260811 18:57:50.099398 10255 raft_consensus.cc:2454] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5683b6aba5124fd2baaad86d5d0bd248 in term 0.
I20260811 18:57:50.099452 9815 leader_election.cc:302] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5683b6aba5124fd2baaad86d5d0bd248, 6991f49b0d5a48b08ad92795be6d8802; no voters:
I20260811 18:57:50.099586 10401 raft_consensus.cc:2781] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:50.099632 10401 raft_consensus.cc:482] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:50.099645 10401 raft_consensus.cc:3037] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:50.100332 10401 raft_consensus.cc:504] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:50.100455 10401 leader_election.cc:288] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [CANDIDATE]: Term 1 election: Requested vote from peers 6991f49b0d5a48b08ad92795be6d8802 (127.5.226.65:36777), f886638c6cad4826bb3b426ee1c73249 (127.5.226.67:41839)
I20260811 18:57:50.100631 9675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1e1841f7051421a9c9b236ed6a68883" candidate_uuid: "5683b6aba5124fd2baaad86d5d0bd248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6991f49b0d5a48b08ad92795be6d8802"
I20260811 18:57:50.100708 9675 raft_consensus.cc:3037] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:50.101405 9675 raft_consensus.cc:2454] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5683b6aba5124fd2baaad86d5d0bd248 in term 1.
I20260811 18:57:50.101384 10255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1e1841f7051421a9c9b236ed6a68883" candidate_uuid: "5683b6aba5124fd2baaad86d5d0bd248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f886638c6cad4826bb3b426ee1c73249"
I20260811 18:57:50.101454 10255 raft_consensus.cc:3037] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:50.101565 9815 leader_election.cc:302] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5683b6aba5124fd2baaad86d5d0bd248, 6991f49b0d5a48b08ad92795be6d8802; no voters:
I20260811 18:57:50.101657 10401 raft_consensus.cc:2781] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:50.101827 10401 raft_consensus.cc:686] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 LEADER]: Becoming Leader. State: Replica: 5683b6aba5124fd2baaad86d5d0bd248, State: Running, Role: LEADER
I20260811 18:57:50.101950 10401 consensus_queue.cc:237] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:50.102288 10255 raft_consensus.cc:2454] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5683b6aba5124fd2baaad86d5d0bd248 in term 1.
I20260811 18:57:50.102429 10437 tablet_replica.cc:439] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248: TxnStatusTablet state changed. Reason: New leader 5683b6aba5124fd2baaad86d5d0bd248. Latest consensus state: current_term: 1 leader_uuid: "5683b6aba5124fd2baaad86d5d0bd248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } }
I20260811 18:57:50.102550 10437 tablet_replica.cc:442] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:57:50.102831 9371 catalog_manager.cc:5495] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5683b6aba5124fd2baaad86d5d0bd248 (127.5.226.66). New cstate: current_term: 1 leader_uuid: "5683b6aba5124fd2baaad86d5d0bd248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } health_report { overall_health: UNKNOWN } } }
I20260811 18:57:50.103132 10441 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 18:57:50.103263 10441 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 18:57:50.125313 10384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.122533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42978 (local address 127.5.226.66:40343)
0811 18:57:50.122586 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:50.122588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:50.122595 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:57:50.122690 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:50.122691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:50.122709 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:50.122781 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:50.122920 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.123413 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.124517 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.124713 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.124780 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.124967 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:50.125070 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:50.125125 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:50.125184 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 18:57:50.125204 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 18:57:50.125389 10426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.122463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:40343 (local address 127.0.0.1:42978)
0811 18:57:50.122539 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:50.122552 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:50.122606 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:50.122796 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:50.122797 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:50.122798 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:57:50.122859 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.122862 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.123481 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.123482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.124426 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.124430 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.124790 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.124791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.124859 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.124879 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:57:50.125123 (+ 244us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:57:50.125129 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 18:57:50.125181 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 18:57:50.125234 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 18:57:50.127394 10255 raft_consensus.cc:1261] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Refusing update from remote peer 5683b6aba5124fd2baaad86d5d0bd248: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:50.127394 9675 raft_consensus.cc:1261] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Refusing update from remote peer 5683b6aba5124fd2baaad86d5d0bd248: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:50.127733 10401 consensus_queue.cc:1035] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:50.127866 10437 consensus_queue.cc:1035] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:50.129102 10402 tablet_replica.cc:439] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802: TxnStatusTablet state changed. Reason: New leader 5683b6aba5124fd2baaad86d5d0bd248. Latest consensus state: current_term: 1 leader_uuid: "5683b6aba5124fd2baaad86d5d0bd248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } }
I20260811 18:57:50.129102 10404 tablet_replica.cc:439] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249: TxnStatusTablet state changed. Reason: New leader 5683b6aba5124fd2baaad86d5d0bd248. Latest consensus state: current_term: 1 leader_uuid: "5683b6aba5124fd2baaad86d5d0bd248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } }
I20260811 18:57:50.129200 10402 tablet_replica.cc:442] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:57:50.129200 10404 tablet_replica.cc:442] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:57:50.130170 10437 tablet_replica.cc:439] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5683b6aba5124fd2baaad86d5d0bd248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } }
I20260811 18:57:50.130255 10437 tablet_replica.cc:442] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:57:50.130404 10404 tablet_replica.cc:439] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5683b6aba5124fd2baaad86d5d0bd248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } }
I20260811 18:57:50.130492 10404 tablet_replica.cc:442] T d1e1841f7051421a9c9b236ed6a68883 P f886638c6cad4826bb3b426ee1c73249: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:57:50.130618 10446 mvcc.cc:205] Tried to move back new op lower bound from 7317400248838963200 to 7317400248738074624. Current Snapshot: MvccSnapshot[applied={T|T < 7317400248838963200}]
I20260811 18:57:50.130743 10401 tablet_replica.cc:439] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5683b6aba5124fd2baaad86d5d0bd248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } }
I20260811 18:57:50.130815 10401 tablet_replica.cc:442] T d1e1841f7051421a9c9b236ed6a68883 P 5683b6aba5124fd2baaad86d5d0bd248: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:57:50.131063 10402 tablet_replica.cc:439] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5683b6aba5124fd2baaad86d5d0bd248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } } }
I20260811 18:57:50.131145 10402 tablet_replica.cc:442] T d1e1841f7051421a9c9b236ed6a68883 P 6991f49b0d5a48b08ad92795be6d8802: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:57:50.131321 10456 mvcc.cc:205] Tried to move back new op lower bound from 7317400248838963200 to 7317400248738074624. Current Snapshot: MvccSnapshot[applied={T|T < 7317400248838963200}]
I20260811 18:57:50.131608 10453 mvcc.cc:205] Tried to move back new op lower bound from 7317400248838963200 to 7317400248738074624. Current Snapshot: MvccSnapshot[applied={T|T < 7317400248838963200}]
I20260811 18:57:50.136382 10382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.133731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50718 (local address 127.5.226.67:41839)
0811 18:57:50.133774 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:50.133776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:50.133785 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:57:50.133843 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:50.133844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:50.133867 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:50.133947 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:50.134039 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.134792 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.135551 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.135860 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.135937 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.136045 (+ 108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:50.136179 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:50.136255 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:50.136270 (+ 15us) server_negotiation.cc:299] Negotiation successful
0811 18:57:50.136292 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:57:50.141655 10366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.139065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:40343 (local address 127.5.226.67:52497)
0811 18:57:50.139166 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:50.139187 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:50.139240 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:50.139368 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:50.139369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:50.139370 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:57:50.139426 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.139427 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.140262 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.140262 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.140823 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.140824 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.141262 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.141263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.141345 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.141361 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:57:50.141533 (+ 172us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:57:50.141534 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 18:57:50.141562 (+ 28us) client_negotiation.cc:240] Negotiation successful
0811 18:57:50.141599 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 18:57:50.141671 10384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.139140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:52497 (local address 127.5.226.66:40343)
0811 18:57:50.139193 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:50.139194 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:50.139227 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:57:50.139285 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:50.139286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:50.139297 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:50.139365 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:50.139472 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.140196 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.140894 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.141196 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.141256 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.141445 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:50.141479 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:50.141528 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:50.141576 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 18:57:50.141597 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 18:57:50.144011 9675 raft_consensus.cc:1261] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Refusing update from remote peer f886638c6cad4826bb3b426ee1c73249: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:50.144129 9970 raft_consensus.cc:1261] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Refusing update from remote peer f886638c6cad4826bb3b426ee1c73249: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:50.144299 10408 consensus_queue.cc:1035] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:50.144493 10404 consensus_queue.cc:1035] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:50.153594 10067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.150725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:41839 (local address 127.5.226.66:32897)
0811 18:57:50.150790 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:50.150800 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:50.150844 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:50.151088 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:50.151089 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:50.151091 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:57:50.151163 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.151165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.151740 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.151741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.152695 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.152699 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.153121 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.153123 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.153199 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.153221 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:57:50.153449 (+ 228us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:57:50.153451 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:57:50.153487 (+ 36us) client_negotiation.cc:240] Negotiation successful
0811 18:57:50.153532 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 18:57:50.153605 10382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.150899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:32897 (local address 127.5.226.67:41839)
0811 18:57:50.150951 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:50.150953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:50.150961 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:57:50.150984 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:50.150984 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:50.151013 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:50.151058 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:50.151214 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.151675 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.152787 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.153041 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.153116 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.153354 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:50.153395 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:50.153447 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:50.153502 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 18:57:50.153526 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 18:57:50.163663 9368 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:50.163805 9368 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:50.164618 9368 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335: Sending DeleteTablet for 3 replicas of tablet 45e475e690674cf98992d592a2f00138
I20260811 18:57:50.164908 9916 tablet_service.cc:1514] Processing DeleteTablet for tablet 45e475e690674cf98992d592a2f00138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:50 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:42972
I20260811 18:57:50.164968 10212 tablet_service.cc:1514] Processing DeleteTablet for tablet 45e475e690674cf98992d592a2f00138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:50 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:50714
I20260811 18:57:50.165040 9629 tablet_service.cc:1514] Processing DeleteTablet for tablet 45e475e690674cf98992d592a2f00138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:50 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:58078
I20260811 18:57:50.165262 10493 tablet_replica.cc:330] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802: stopping tablet replica
I20260811 18:57:50.165447 10493 raft_consensus.cc:2229] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:50.165552 10493 raft_consensus.cc:2258] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:50.165527 9368 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48402:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:57:50.165678 9368 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:50.166061 10493 ts_tablet_manager.cc:1905] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:50.167131 10212 tablet_service.cc:1467] Processing CreateTablet for tablet 3e65819978254b20a89b35419418a3ad (DEFAULT_TABLE table=test-table [id=741601674e1e4ec9a659949de6c19c11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:50.167259 10212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e65819978254b20a89b35419418a3ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:50.168005 10493 ts_tablet_manager.cc:1918] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:57:50.168076 10493 log.cc:1196] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/wal/wals/45e475e690674cf98992d592a2f00138
I20260811 18:57:50.168330 10493 ts_tablet_manager.cc:1939] T 45e475e690674cf98992d592a2f00138 P 6991f49b0d5a48b08ad92795be6d8802: Deleting consensus metadata
I20260811 18:57:50.168604 10389 tablet_bootstrap.cc:492] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249: Bootstrap starting.
I20260811 18:57:50.168999 10389 tablet_bootstrap.cc:654] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:50.169478 9629 tablet_service.cc:1467] Processing CreateTablet for tablet 3e65819978254b20a89b35419418a3ad (DEFAULT_TABLE table=test-table [id=741601674e1e4ec9a659949de6c19c11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:50.169576 9629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e65819978254b20a89b35419418a3ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:50.169723 10389 tablet_bootstrap.cc:492] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249: No bootstrap required, opened a new log
I20260811 18:57:50.169766 10389 ts_tablet_manager.cc:1397] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:50.169917 10389 raft_consensus.cc:348] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:50.169981 10389 raft_consensus.cc:374] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:50.170001 10389 raft_consensus.cc:729] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f886638c6cad4826bb3b426ee1c73249, State: Initialized, Role: FOLLOWER
I20260811 18:57:50.170030 10389 consensus_queue.cc:260] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:50.170117 10389 ts_tablet_manager.cc:1428] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:50.170728 10387 tablet_bootstrap.cc:492] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802: Bootstrap starting.
I20260811 18:57:50.170843 9346 catalog_manager.cc:4841] TS 6991f49b0d5a48b08ad92795be6d8802 (127.5.226.65:36777): tablet 45e475e690674cf98992d592a2f00138 (table test-table [id=3c900dcfd5d14f11ad04ea1dfe88ac50]) successfully deleted
I20260811 18:57:50.171121 10387 tablet_bootstrap.cc:654] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:50.171581 9916 tablet_service.cc:1467] Processing CreateTablet for tablet 3e65819978254b20a89b35419418a3ad (DEFAULT_TABLE table=test-table [id=741601674e1e4ec9a659949de6c19c11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:50.171708 9916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e65819978254b20a89b35419418a3ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:50.171736 10387 tablet_bootstrap.cc:492] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802: No bootstrap required, opened a new log
I20260811 18:57:50.171778 10387 ts_tablet_manager.cc:1397] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:50.171950 10387 raft_consensus.cc:348] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:50.172014 10387 raft_consensus.cc:374] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:50.172035 10387 raft_consensus.cc:729] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6991f49b0d5a48b08ad92795be6d8802, State: Initialized, Role: FOLLOWER
I20260811 18:57:50.172081 10387 consensus_queue.cc:260] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:50.172166 10387 ts_tablet_manager.cc:1428] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:50.172917 10392 tablet_bootstrap.cc:492] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248: Bootstrap starting.
I20260811 18:57:50.173197 10392 tablet_bootstrap.cc:654] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:50.173770 10490 tablet_replica.cc:330] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248: stopping tablet replica
I20260811 18:57:50.173890 10490 raft_consensus.cc:2229] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:50.173949 10490 raft_consensus.cc:2258] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:50.174347 10490 ts_tablet_manager.cc:1905] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:50.176014 10490 ts_tablet_manager.cc:1918] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:57:50.176093 10490 log.cc:1196] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/45e475e690674cf98992d592a2f00138
I20260811 18:57:50.176798 10490 ts_tablet_manager.cc:1939] T 45e475e690674cf98992d592a2f00138 P 5683b6aba5124fd2baaad86d5d0bd248: Deleting consensus metadata
I20260811 18:57:50.177413 9350 catalog_manager.cc:4841] TS 5683b6aba5124fd2baaad86d5d0bd248 (127.5.226.66:40343): tablet 45e475e690674cf98992d592a2f00138 (table test-table [id=3c900dcfd5d14f11ad04ea1dfe88ac50]) successfully deleted
I20260811 18:57:50.177671 10392 tablet_bootstrap.cc:492] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248: No bootstrap required, opened a new log
I20260811 18:57:50.177713 10392 ts_tablet_manager.cc:1397] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 18:57:50.177855 10392 raft_consensus.cc:348] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:50.177919 10392 raft_consensus.cc:374] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:50.177938 10392 raft_consensus.cc:729] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5683b6aba5124fd2baaad86d5d0bd248, State: Initialized, Role: FOLLOWER
I20260811 18:57:50.177979 10392 consensus_queue.cc:260] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:50.178068 10392 ts_tablet_manager.cc:1428] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:50.181378 10491 tablet_replica.cc:330] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249: stopping tablet replica
I20260811 18:57:50.181495 10491 raft_consensus.cc:2229] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:57:50.181609 10491 raft_consensus.cc:2258] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:50.182005 10491 ts_tablet_manager.cc:1905] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:50.183848 10491 ts_tablet_manager.cc:1918] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:57:50.183928 10491 log.cc:1196] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/45e475e690674cf98992d592a2f00138
I20260811 18:57:50.184167 10491 ts_tablet_manager.cc:1939] T 45e475e690674cf98992d592a2f00138 P f886638c6cad4826bb3b426ee1c73249: Deleting consensus metadata
I20260811 18:57:50.184578 9347 catalog_manager.cc:4841] TS f886638c6cad4826bb3b426ee1c73249 (127.5.226.67:41839): tablet 45e475e690674cf98992d592a2f00138 (table test-table [id=3c900dcfd5d14f11ad04ea1dfe88ac50]) successfully deleted
I20260811 18:57:50.360690 10402 raft_consensus.cc:482] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:50.360818 10402 raft_consensus.cc:504] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:50.361279 10402 leader_election.cc:288] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5683b6aba5124fd2baaad86d5d0bd248 (127.5.226.66:40343), f886638c6cad4826bb3b426ee1c73249 (127.5.226.67:41839)
I20260811 18:57:50.364137 10382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.361613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:56263 (local address 127.5.226.67:41839)
0811 18:57:50.361678 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:50.361680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:50.361749 (+ 69us) server_negotiation.cc:407] Connection header received
0811 18:57:50.361811 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:50.361812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:50.361824 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:50.361874 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:50.361999 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.362469 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.363508 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.363854 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.363917 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.363926 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:50.364033 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 18:57:50.364064 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 18:57:50.364154 10507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.361517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:41839 (local address 127.5.226.65:56263)
0811 18:57:50.361676 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:50.361687 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:50.361755 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:50.361882 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:50.361883 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:50.361885 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:50.361944 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.361946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.362539 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.362540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.363427 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.363430 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.363921 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.363922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.363976 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.363979 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:57:50.364023 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 18:57:50.364063 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":67,"threads_started":1}
I20260811 18:57:50.364229 10384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.361596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:35463 (local address 127.5.226.66:40343)
0811 18:57:50.361713 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:50.361715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:50.361791 (+ 76us) server_negotiation.cc:407] Connection header received
0811 18:57:50.361864 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:50.361865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:50.361880 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:50.361925 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:50.362085 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.362552 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.363534 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.363891 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.363963 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.363973 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:50.364116 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 18:57:50.364161 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 18:57:50.364372 10255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e65819978254b20a89b35419418a3ad" candidate_uuid: "6991f49b0d5a48b08ad92795be6d8802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f886638c6cad4826bb3b426ee1c73249" is_pre_election: true
I20260811 18:57:50.364457 10500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.361519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:40343 (local address 127.5.226.65:35463)
0811 18:57:50.361714 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:50.361725 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:50.361795 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:50.361946 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:50.361947 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:50.361950 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:50.362024 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.362026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.362633 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.362634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.363446 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.363449 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.363970 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.363971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.364051 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.364055 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:50.364109 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 18:57:50.364151 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":106,"threads_started":1}
I20260811 18:57:50.364465 10255 raft_consensus.cc:2454] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6991f49b0d5a48b08ad92795be6d8802 in term 0.
I20260811 18:57:50.364638 9547 leader_election.cc:302] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6991f49b0d5a48b08ad92795be6d8802, f886638c6cad4826bb3b426ee1c73249; no voters:
I20260811 18:57:50.364776 10402 raft_consensus.cc:2781] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:50.364737 9970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e65819978254b20a89b35419418a3ad" candidate_uuid: "6991f49b0d5a48b08ad92795be6d8802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5683b6aba5124fd2baaad86d5d0bd248" is_pre_election: true
I20260811 18:57:50.364825 10402 raft_consensus.cc:482] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:50.364835 9970 raft_consensus.cc:2454] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6991f49b0d5a48b08ad92795be6d8802 in term 0.
I20260811 18:57:50.364848 10402 raft_consensus.cc:3037] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:50.365660 10402 raft_consensus.cc:504] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:50.365818 10402 leader_election.cc:288] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [CANDIDATE]: Term 1 election: Requested vote from peers 5683b6aba5124fd2baaad86d5d0bd248 (127.5.226.66:40343), f886638c6cad4826bb3b426ee1c73249 (127.5.226.67:41839)
I20260811 18:57:50.365983 9970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e65819978254b20a89b35419418a3ad" candidate_uuid: "6991f49b0d5a48b08ad92795be6d8802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5683b6aba5124fd2baaad86d5d0bd248"
I20260811 18:57:50.366007 10255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e65819978254b20a89b35419418a3ad" candidate_uuid: "6991f49b0d5a48b08ad92795be6d8802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f886638c6cad4826bb3b426ee1c73249"
I20260811 18:57:50.366063 9970 raft_consensus.cc:3037] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:50.366076 10255 raft_consensus.cc:3037] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:50.366789 9970 raft_consensus.cc:2454] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6991f49b0d5a48b08ad92795be6d8802 in term 1.
I20260811 18:57:50.366796 10255 raft_consensus.cc:2454] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6991f49b0d5a48b08ad92795be6d8802 in term 1.
I20260811 18:57:50.366961 9547 leader_election.cc:302] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6991f49b0d5a48b08ad92795be6d8802, f886638c6cad4826bb3b426ee1c73249; no voters:
I20260811 18:57:50.367044 10402 raft_consensus.cc:2781] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:50.367216 10402 raft_consensus.cc:686] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [term 1 LEADER]: Becoming Leader. State: Replica: 6991f49b0d5a48b08ad92795be6d8802, State: Running, Role: LEADER
I20260811 18:57:50.367287 10402 consensus_queue.cc:237] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:50.368036 9371 catalog_manager.cc:5495] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6991f49b0d5a48b08ad92795be6d8802 (127.5.226.65). New cstate: current_term: 1 leader_uuid: "6991f49b0d5a48b08ad92795be6d8802" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } health_report { overall_health: UNKNOWN } } }
I20260811 18:57:50.407231 10385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.404832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58090 (local address 127.5.226.65:36777)
0811 18:57:50.404872 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:50.404874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:50.404926 (+ 52us) server_negotiation.cc:407] Connection header received
0811 18:57:50.405012 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:50.405013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:50.405037 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:50.405102 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:50.405211 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.405752 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.406482 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.406689 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.406744 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.406904 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:50.407019 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:50.407086 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:50.407123 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 18:57:50.407147 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 18:57:50.411746 10384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.409637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:56423 (local address 127.5.226.66:40343)
0811 18:57:50.409718 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:50.409720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:50.409772 (+ 52us) server_negotiation.cc:407] Connection header received
0811 18:57:50.409820 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:50.409821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:50.409830 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:50.409874 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:50.409983 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.410443 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.411150 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.411359 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.411426 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.411574 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:50.411600 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:50.411633 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:50.411670 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 18:57:50.411687 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 18:57:50.411782 10521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.409571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:40343 (local address 127.5.226.65:56423)
0811 18:57:50.409716 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:50.409726 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:50.409778 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:50.409880 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:50.409881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:50.409882 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:57:50.409944 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.409945 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.410501 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.410501 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.411061 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.411063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.411450 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.411451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.411499 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.411514 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:57:50.411638 (+ 124us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:57:50.411639 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 18:57:50.411667 (+ 28us) client_negotiation.cc:240] Negotiation successful
0811 18:57:50.411700 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":70,"threads_started":1}
I20260811 18:57:50.414024 10255 raft_consensus.cc:1261] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Refusing update from remote peer 6991f49b0d5a48b08ad92795be6d8802: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:50.414065 9970 raft_consensus.cc:1261] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Refusing update from remote peer 6991f49b0d5a48b08ad92795be6d8802: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:50.414279 10402 consensus_queue.cc:1035] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:50.414456 10516 consensus_queue.cc:1035] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:50.421484 10385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.419240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:60945 (local address 127.5.226.65:36777)
0811 18:57:50.419294 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:50.419296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:50.419304 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:57:50.419325 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:50.419326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:50.419336 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:50.419379 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:50.419516 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.420109 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.420823 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.421004 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.421063 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.421209 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:50.421243 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:50.421305 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:50.421390 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 18:57:50.421412 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:57:50.421507 10067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:50.419188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:36777 (local address 127.5.226.66:60945)
0811 18:57:50.419226 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:50.419236 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:50.419272 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:50.419380 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:50.419381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:50.419382 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:57:50.419427 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.419429 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.420174 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.420174 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.420743 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:50.420745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:50.421082 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:50.421083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:50.421144 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:50.421150 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:57:50.421331 (+ 181us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:57:50.421333 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:57:50.421383 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 18:57:50.421436 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 18:57:50.421846 10453 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 18:57:51.941154 9371 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:51.941257 9371 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:51.942041 9371 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335: Sending DeleteTablet for 3 replicas of tablet 3e65819978254b20a89b35419418a3ad
I20260811 18:57:51.942289 9629 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e65819978254b20a89b35419418a3ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:51 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:58078
I20260811 18:57:51.942376 9916 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e65819978254b20a89b35419418a3ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:51 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:42972
I20260811 18:57:51.942479 10212 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e65819978254b20a89b35419418a3ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:51 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:50714
I20260811 18:57:51.942660 10579 tablet_replica.cc:330] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249: stopping tablet replica
I20260811 18:57:51.942718 10579 raft_consensus.cc:2229] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:51.942747 10579 raft_consensus.cc:2258] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:51.942976 10579 ts_tablet_manager.cc:1905] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:51.944250 10576 tablet_replica.cc:330] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802: stopping tablet replica
I20260811 18:57:51.944348 10576 raft_consensus.cc:2229] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:57:51.944475 10576 raft_consensus.cc:2258] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:51.944644 10579 ts_tablet_manager.cc:1918] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:57:51.944754 10579 log.cc:1196] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/3e65819978254b20a89b35419418a3ad
I20260811 18:57:51.944766 10576 ts_tablet_manager.cc:1905] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:51.945000 10579 ts_tablet_manager.cc:1939] T 3e65819978254b20a89b35419418a3ad P f886638c6cad4826bb3b426ee1c73249: Deleting consensus metadata
I20260811 18:57:51.945356 9347 catalog_manager.cc:4841] TS f886638c6cad4826bb3b426ee1c73249 (127.5.226.67:41839): tablet 3e65819978254b20a89b35419418a3ad (table test-table [id=741601674e1e4ec9a659949de6c19c11]) successfully deleted
I20260811 18:57:51.945699 10577 tablet_replica.cc:330] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248: stopping tablet replica
I20260811 18:57:51.945755 10577 raft_consensus.cc:2229] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:51.945812 10577 raft_consensus.cc:2258] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:51.946020 10577 ts_tablet_manager.cc:1905] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:51.946336 10576 ts_tablet_manager.cc:1918] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:57:51.946389 10576 log.cc:1196] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/wal/wals/3e65819978254b20a89b35419418a3ad
I20260811 18:57:51.946571 10576 ts_tablet_manager.cc:1939] T 3e65819978254b20a89b35419418a3ad P 6991f49b0d5a48b08ad92795be6d8802: Deleting consensus metadata
I20260811 18:57:51.946938 9346 catalog_manager.cc:4841] TS 6991f49b0d5a48b08ad92795be6d8802 (127.5.226.65:36777): tablet 3e65819978254b20a89b35419418a3ad (table test-table [id=741601674e1e4ec9a659949de6c19c11]) successfully deleted
I20260811 18:57:51.947345 10577 ts_tablet_manager.cc:1918] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:57:51.947392 10577 log.cc:1196] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/3e65819978254b20a89b35419418a3ad
I20260811 18:57:51.947562 10577 ts_tablet_manager.cc:1939] T 3e65819978254b20a89b35419418a3ad P 5683b6aba5124fd2baaad86d5d0bd248: Deleting consensus metadata
I20260811 18:57:51.948007 9350 catalog_manager.cc:4841] TS 5683b6aba5124fd2baaad86d5d0bd248 (127.5.226.66:40343): tablet 3e65819978254b20a89b35419418a3ad (table test-table [id=741601674e1e4ec9a659949de6c19c11]) successfully deleted
Aug 11 18:57:51 dist-test-slave-gjw7 krb5kdc[9280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474671, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:57:51 dist-test-slave-gjw7 krb5kdc[9280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474671, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:51.970741 10595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:51.960202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48428 (local address 127.5.226.126:34351)
0811 18:57:51.960359 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:51.960361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:51.960371 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:57:51.960440 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:51.960441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:51.960453 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:51.960506 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:51.961035 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:51.961587 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:51.962301 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:51.962504 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:51.962559 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:51.968391 (+ 5832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:51.968392 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:51.968392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:51.968400 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:51.969721 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:51.970024 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:51.970025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:51.970025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:51.970079 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:51.970235 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:51.970236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:51.970236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:51.970352 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:51.970440 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:51.970554 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 18:57:51.970641 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
I20260811 18:57:51.972033 9371 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:57:51.972187 9371 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:51.973495 9629 tablet_service.cc:1467] Processing CreateTablet for tablet 6d73e35a256946bbbe45d43ba22ff491 (DEFAULT_TABLE table=test-table [id=54978e92656a4ae3ade2655128ade5f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:51.973528 10212 tablet_service.cc:1467] Processing CreateTablet for tablet 6d73e35a256946bbbe45d43ba22ff491 (DEFAULT_TABLE table=test-table [id=54978e92656a4ae3ade2655128ade5f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:51.973634 9629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d73e35a256946bbbe45d43ba22ff491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:51.973651 10212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d73e35a256946bbbe45d43ba22ff491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:51.973618 9916 tablet_service.cc:1467] Processing CreateTablet for tablet 6d73e35a256946bbbe45d43ba22ff491 (DEFAULT_TABLE table=test-table [id=54978e92656a4ae3ade2655128ade5f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:51.973730 9916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d73e35a256946bbbe45d43ba22ff491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:51.974727 10597 tablet_bootstrap.cc:492] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249: Bootstrap starting.
I20260811 18:57:51.975103 10597 tablet_bootstrap.cc:654] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:51.975354 10599 tablet_bootstrap.cc:492] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802: Bootstrap starting.
I20260811 18:57:51.975442 10601 tablet_bootstrap.cc:492] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248: Bootstrap starting.
I20260811 18:57:51.975790 10597 tablet_bootstrap.cc:492] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249: No bootstrap required, opened a new log
I20260811 18:57:51.975838 10601 tablet_bootstrap.cc:654] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:51.975850 10597 ts_tablet_manager.cc:1397] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:51.975983 10597 raft_consensus.cc:348] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:51.976065 10597 raft_consensus.cc:374] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:51.976094 10597 raft_consensus.cc:729] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f886638c6cad4826bb3b426ee1c73249, State: Initialized, Role: FOLLOWER
I20260811 18:57:51.976136 10597 consensus_queue.cc:260] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:51.976320 10597 ts_tablet_manager.cc:1428] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:51.976405 10599 tablet_bootstrap.cc:654] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:51.976429 10601 tablet_bootstrap.cc:492] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248: No bootstrap required, opened a new log
I20260811 18:57:51.976473 10601 ts_tablet_manager.cc:1397] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:51.976613 10601 raft_consensus.cc:348] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:51.976747 10601 raft_consensus.cc:374] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:51.976833 10601 raft_consensus.cc:729] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5683b6aba5124fd2baaad86d5d0bd248, State: Initialized, Role: FOLLOWER
I20260811 18:57:51.976933 10601 consensus_queue.cc:260] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:51.977023 10599 tablet_bootstrap.cc:492] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802: No bootstrap required, opened a new log
I20260811 18:57:51.977082 10599 ts_tablet_manager.cc:1397] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:57:51.977151 10601 ts_tablet_manager.cc:1428] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 18:57:51.977262 10599 raft_consensus.cc:348] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:51.977363 10599 raft_consensus.cc:374] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:51.977391 10599 raft_consensus.cc:729] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6991f49b0d5a48b08ad92795be6d8802, State: Initialized, Role: FOLLOWER
I20260811 18:57:51.977437 10599 consensus_queue.cc:260] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:51.977541 10599 ts_tablet_manager.cc:1428] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:52.151559 10552 raft_consensus.cc:482] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:52.151669 10552 raft_consensus.cc:504] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:52.151880 10552 leader_election.cc:288] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6991f49b0d5a48b08ad92795be6d8802 (127.5.226.65:36777), f886638c6cad4826bb3b426ee1c73249 (127.5.226.67:41839)
I20260811 18:57:52.152158 9675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d73e35a256946bbbe45d43ba22ff491" candidate_uuid: "5683b6aba5124fd2baaad86d5d0bd248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6991f49b0d5a48b08ad92795be6d8802" is_pre_election: true
I20260811 18:57:52.152158 10255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d73e35a256946bbbe45d43ba22ff491" candidate_uuid: "5683b6aba5124fd2baaad86d5d0bd248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f886638c6cad4826bb3b426ee1c73249" is_pre_election: true
I20260811 18:57:52.152281 9675 raft_consensus.cc:2454] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5683b6aba5124fd2baaad86d5d0bd248 in term 0.
I20260811 18:57:52.152281 10255 raft_consensus.cc:2454] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5683b6aba5124fd2baaad86d5d0bd248 in term 0.
I20260811 18:57:52.152544 9815 leader_election.cc:302] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5683b6aba5124fd2baaad86d5d0bd248, 6991f49b0d5a48b08ad92795be6d8802, f886638c6cad4826bb3b426ee1c73249; no voters:
I20260811 18:57:52.152668 10552 raft_consensus.cc:2781] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:52.152719 10552 raft_consensus.cc:482] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:52.152732 10552 raft_consensus.cc:3037] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:52.153704 10552 raft_consensus.cc:504] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:52.153834 10552 leader_election.cc:288] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [CANDIDATE]: Term 1 election: Requested vote from peers 6991f49b0d5a48b08ad92795be6d8802 (127.5.226.65:36777), f886638c6cad4826bb3b426ee1c73249 (127.5.226.67:41839)
I20260811 18:57:52.154013 9675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d73e35a256946bbbe45d43ba22ff491" candidate_uuid: "5683b6aba5124fd2baaad86d5d0bd248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6991f49b0d5a48b08ad92795be6d8802"
I20260811 18:57:52.154018 10255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d73e35a256946bbbe45d43ba22ff491" candidate_uuid: "5683b6aba5124fd2baaad86d5d0bd248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f886638c6cad4826bb3b426ee1c73249"
I20260811 18:57:52.154091 10255 raft_consensus.cc:3037] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:52.154093 9675 raft_consensus.cc:3037] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:52.154863 10255 raft_consensus.cc:2454] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5683b6aba5124fd2baaad86d5d0bd248 in term 1.
I20260811 18:57:52.154875 9675 raft_consensus.cc:2454] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5683b6aba5124fd2baaad86d5d0bd248 in term 1.
I20260811 18:57:52.155021 9816 leader_election.cc:302] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5683b6aba5124fd2baaad86d5d0bd248, f886638c6cad4826bb3b426ee1c73249; no voters:
I20260811 18:57:52.155126 10552 raft_consensus.cc:2781] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:52.155190 10552 raft_consensus.cc:686] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 LEADER]: Becoming Leader. State: Replica: 5683b6aba5124fd2baaad86d5d0bd248, State: Running, Role: LEADER
I20260811 18:57:52.155242 10552 consensus_queue.cc:237] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:52.155864 9368 catalog_manager.cc:5495] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5683b6aba5124fd2baaad86d5d0bd248 (127.5.226.66). New cstate: current_term: 1 leader_uuid: "5683b6aba5124fd2baaad86d5d0bd248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } health_report { overall_health: UNKNOWN } } }
I20260811 18:57:52.205344 10623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:52.203256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42986 (local address 127.5.226.66:40343)
0811 18:57:52.203395 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:52.203396 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:52.203405 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:57:52.203425 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:52.203425 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:52.203436 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:52.203492 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:52.203604 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:52.204088 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:52.204791 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:52.204985 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:52.205035 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:52.205134 (+ 99us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:52.205161 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:52.205193 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:52.205232 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 18:57:52.205251 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":82,"threads_started":1}
I20260811 18:57:52.209251 10623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:52.207451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:36435 (local address 127.5.226.66:40343)
0811 18:57:52.207497 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:52.207498 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:52.207507 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:57:52.207555 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:52.207556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:52.207564 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:52.207604 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:52.207677 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:52.208105 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:52.208752 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:52.208924 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:52.208966 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:52.209076 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:52.209099 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:52.209129 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:52.209163 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 18:57:52.209177 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:57:52.209264 10634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:52.207315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:40343 (local address 127.5.226.66:36435)
0811 18:57:52.207460 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:52.207472 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:52.207517 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:52.207608 (+ 91us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:52.207608 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:52.207610 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:57:52.207645 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:52.207646 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:52.208155 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:52.208155 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:52.208697 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:52.208698 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:52.208983 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:52.208984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:52.209027 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:52.209031 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:57:52.209129 (+ 98us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:57:52.209129 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 18:57:52.209154 (+ 25us) client_negotiation.cc:240] Negotiation successful
0811 18:57:52.209188 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":91,"threads_started":1}
I20260811 18:57:52.211087 10255 raft_consensus.cc:1261] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Refusing update from remote peer 5683b6aba5124fd2baaad86d5d0bd248: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:52.211089 9675 raft_consensus.cc:1261] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Refusing update from remote peer 5683b6aba5124fd2baaad86d5d0bd248: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:52.211267 10538 consensus_queue.cc:1035] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:52.211369 10534 consensus_queue.cc:1035] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:52.221477 9368 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:52.221566 9368 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:52.222155 9368 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335: Sending DeleteTablet for 3 replicas of tablet 6d73e35a256946bbbe45d43ba22ff491
I20260811 18:57:52.222419 9629 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d73e35a256946bbbe45d43ba22ff491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:52 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:58078
I20260811 18:57:52.222515 10576 tablet_replica.cc:330] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802: stopping tablet replica
I20260811 18:57:52.222508 10212 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d73e35a256946bbbe45d43ba22ff491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:52 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:50714
I20260811 18:57:52.222561 10576 raft_consensus.cc:2229] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:52.222581 10579 tablet_replica.cc:330] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249: stopping tablet replica
I20260811 18:57:52.222594 10576 raft_consensus.cc:2258] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:52.222626 10579 raft_consensus.cc:2229] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:52.222659 10579 raft_consensus.cc:2258] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:52.222808 9916 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d73e35a256946bbbe45d43ba22ff491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:52 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:42972
I20260811 18:57:52.222889 10577 tablet_replica.cc:330] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248: stopping tablet replica
I20260811 18:57:52.222940 10577 raft_consensus.cc:2229] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:57:52.223028 10577 raft_consensus.cc:2258] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:52.223240 10579 ts_tablet_manager.cc:1905] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:52.224431 9368 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:57:52.224593 9368 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:52.224881 10577 ts_tablet_manager.cc:1905] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:52.225485 10579 ts_tablet_manager.cc:1918] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:57:52.225556 10579 log.cc:1196] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/6d73e35a256946bbbe45d43ba22ff491
I20260811 18:57:52.225806 10579 ts_tablet_manager.cc:1939] T 6d73e35a256946bbbe45d43ba22ff491 P f886638c6cad4826bb3b426ee1c73249: Deleting consensus metadata
I20260811 18:57:52.226171 9347 catalog_manager.cc:4841] TS f886638c6cad4826bb3b426ee1c73249 (127.5.226.67:41839): tablet 6d73e35a256946bbbe45d43ba22ff491 (table test-table [id=54978e92656a4ae3ade2655128ade5f3]) successfully deleted
I20260811 18:57:52.226212 10577 ts_tablet_manager.cc:1918] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:57:52.226258 10577 log.cc:1196] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/6d73e35a256946bbbe45d43ba22ff491
I20260811 18:57:52.226274 10576 ts_tablet_manager.cc:1905] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:52.226454 10577 ts_tablet_manager.cc:1939] T 6d73e35a256946bbbe45d43ba22ff491 P 5683b6aba5124fd2baaad86d5d0bd248: Deleting consensus metadata
I20260811 18:57:52.227382 10212 tablet_service.cc:1467] Processing CreateTablet for tablet 6ef6f975fd4145a9a93d68f3b5ba6745 (DEFAULT_TABLE table=test-table [id=a84e86773d78482ebc38f4bd3337c4ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:52.227382 9629 tablet_service.cc:1467] Processing CreateTablet for tablet 6ef6f975fd4145a9a93d68f3b5ba6745 (DEFAULT_TABLE table=test-table [id=a84e86773d78482ebc38f4bd3337c4ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:52.227494 10212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ef6f975fd4145a9a93d68f3b5ba6745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:52.227494 9629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ef6f975fd4145a9a93d68f3b5ba6745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:52.227839 10576 ts_tablet_manager.cc:1918] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:57:52.227896 10576 log.cc:1196] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-0/wal/wals/6d73e35a256946bbbe45d43ba22ff491
I20260811 18:57:52.228103 10576 ts_tablet_manager.cc:1939] T 6d73e35a256946bbbe45d43ba22ff491 P 6991f49b0d5a48b08ad92795be6d8802: Deleting consensus metadata
I20260811 18:57:52.228672 10599 tablet_bootstrap.cc:492] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 6991f49b0d5a48b08ad92795be6d8802: Bootstrap starting.
I20260811 18:57:52.228946 10599 tablet_bootstrap.cc:654] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 6991f49b0d5a48b08ad92795be6d8802: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:52.229198 10597 tablet_bootstrap.cc:492] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249: Bootstrap starting.
I20260811 18:57:52.229352 9350 catalog_manager.cc:4841] TS 5683b6aba5124fd2baaad86d5d0bd248 (127.5.226.66:40343): tablet 6d73e35a256946bbbe45d43ba22ff491 (table test-table [id=54978e92656a4ae3ade2655128ade5f3]) successfully deleted
I20260811 18:57:52.229532 9346 catalog_manager.cc:4841] TS 6991f49b0d5a48b08ad92795be6d8802 (127.5.226.65:36777): tablet 6d73e35a256946bbbe45d43ba22ff491 (table test-table [id=54978e92656a4ae3ade2655128ade5f3]) successfully deleted
I20260811 18:57:52.229882 10597 tablet_bootstrap.cc:654] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:52.230450 10599 tablet_bootstrap.cc:492] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 6991f49b0d5a48b08ad92795be6d8802: No bootstrap required, opened a new log
I20260811 18:57:52.230495 10599 ts_tablet_manager.cc:1397] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 6991f49b0d5a48b08ad92795be6d8802: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 18:57:52.230610 10599 raft_consensus.cc:348] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:52.230671 10599 raft_consensus.cc:374] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:52.230684 10599 raft_consensus.cc:729] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6991f49b0d5a48b08ad92795be6d8802, State: Initialized, Role: FOLLOWER
I20260811 18:57:52.230719 10599 consensus_queue.cc:260] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 6991f49b0d5a48b08ad92795be6d8802 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:52.230813 10599 ts_tablet_manager.cc:1428] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 6991f49b0d5a48b08ad92795be6d8802: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:52.230928 9916 tablet_service.cc:1467] Processing CreateTablet for tablet 6ef6f975fd4145a9a93d68f3b5ba6745 (DEFAULT_TABLE table=test-table [id=a84e86773d78482ebc38f4bd3337c4ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:52.231019 9916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ef6f975fd4145a9a93d68f3b5ba6745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:52.231870 10601 tablet_bootstrap.cc:492] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248: Bootstrap starting.
I20260811 18:57:52.232225 10601 tablet_bootstrap.cc:654] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:52.232249 10597 tablet_bootstrap.cc:492] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249: No bootstrap required, opened a new log
I20260811 18:57:52.232295 10597 ts_tablet_manager.cc:1397] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 18:57:52.232402 10597 raft_consensus.cc:348] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:52.232465 10597 raft_consensus.cc:374] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:52.232482 10597 raft_consensus.cc:729] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f886638c6cad4826bb3b426ee1c73249, State: Initialized, Role: FOLLOWER
I20260811 18:57:52.232520 10597 consensus_queue.cc:260] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:52.232620 10597 ts_tablet_manager.cc:1428] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:52.232800 10601 tablet_bootstrap.cc:492] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248: No bootstrap required, opened a new log
I20260811 18:57:52.232846 10601 ts_tablet_manager.cc:1397] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:52.232949 10601 raft_consensus.cc:348] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:52.233016 10601 raft_consensus.cc:374] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:52.233037 10601 raft_consensus.cc:729] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5683b6aba5124fd2baaad86d5d0bd248, State: Initialized, Role: FOLLOWER
I20260811 18:57:52.233083 10601 consensus_queue.cc:260] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:52.233165 10601 ts_tablet_manager.cc:1428] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:52.249480 10644 raft_consensus.cc:482] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:52.249570 10644 raft_consensus.cc:504] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:52.249732 10644 leader_election.cc:288] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6991f49b0d5a48b08ad92795be6d8802 (127.5.226.65:36777), f886638c6cad4826bb3b426ee1c73249 (127.5.226.67:41839)
I20260811 18:57:52.249902 9675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ef6f975fd4145a9a93d68f3b5ba6745" candidate_uuid: "5683b6aba5124fd2baaad86d5d0bd248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6991f49b0d5a48b08ad92795be6d8802" is_pre_election: true
I20260811 18:57:52.249989 9675 raft_consensus.cc:2454] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5683b6aba5124fd2baaad86d5d0bd248 in term 0.
I20260811 18:57:52.249941 10252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ef6f975fd4145a9a93d68f3b5ba6745" candidate_uuid: "5683b6aba5124fd2baaad86d5d0bd248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f886638c6cad4826bb3b426ee1c73249" is_pre_election: true
I20260811 18:57:52.250066 10252 raft_consensus.cc:2454] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5683b6aba5124fd2baaad86d5d0bd248 in term 0.
I20260811 18:57:52.250120 9815 leader_election.cc:302] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5683b6aba5124fd2baaad86d5d0bd248, 6991f49b0d5a48b08ad92795be6d8802; no voters:
I20260811 18:57:52.250207 10644 raft_consensus.cc:2781] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:52.250243 10644 raft_consensus.cc:482] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:52.250267 10644 raft_consensus.cc:3037] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:52.250926 10644 raft_consensus.cc:504] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:52.251034 10644 leader_election.cc:288] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [CANDIDATE]: Term 1 election: Requested vote from peers 6991f49b0d5a48b08ad92795be6d8802 (127.5.226.65:36777), f886638c6cad4826bb3b426ee1c73249 (127.5.226.67:41839)
I20260811 18:57:52.251168 10252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ef6f975fd4145a9a93d68f3b5ba6745" candidate_uuid: "5683b6aba5124fd2baaad86d5d0bd248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f886638c6cad4826bb3b426ee1c73249"
I20260811 18:57:52.251207 9675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ef6f975fd4145a9a93d68f3b5ba6745" candidate_uuid: "5683b6aba5124fd2baaad86d5d0bd248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6991f49b0d5a48b08ad92795be6d8802"
I20260811 18:57:52.251282 10252 raft_consensus.cc:3037] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:52.251282 9675 raft_consensus.cc:3037] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 6991f49b0d5a48b08ad92795be6d8802 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:52.251931 10252 raft_consensus.cc:2454] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5683b6aba5124fd2baaad86d5d0bd248 in term 1.
I20260811 18:57:52.252085 9816 leader_election.cc:302] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5683b6aba5124fd2baaad86d5d0bd248, f886638c6cad4826bb3b426ee1c73249; no voters:
I20260811 18:57:52.252099 9675 raft_consensus.cc:2454] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5683b6aba5124fd2baaad86d5d0bd248 in term 1.
I20260811 18:57:52.252159 10644 raft_consensus.cc:2781] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:52.252214 10644 raft_consensus.cc:686] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 LEADER]: Becoming Leader. State: Replica: 5683b6aba5124fd2baaad86d5d0bd248, State: Running, Role: LEADER
I20260811 18:57:52.252257 10644 consensus_queue.cc:237] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } }
I20260811 18:57:52.252801 9371 catalog_manager.cc:5495] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5683b6aba5124fd2baaad86d5d0bd248 (127.5.226.66). New cstate: current_term: 1 leader_uuid: "5683b6aba5124fd2baaad86d5d0bd248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5683b6aba5124fd2baaad86d5d0bd248" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 } health_report { overall_health: UNKNOWN } } }
I20260811 18:57:52.264127 9675 raft_consensus.cc:1261] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 6991f49b0d5a48b08ad92795be6d8802 [term 1 FOLLOWER]: Refusing update from remote peer 5683b6aba5124fd2baaad86d5d0bd248: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:52.264130 10252 raft_consensus.cc:1261] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Refusing update from remote peer 5683b6aba5124fd2baaad86d5d0bd248: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:52.264333 10534 consensus_queue.cc:1035] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f886638c6cad4826bb3b426ee1c73249" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 41839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:52.264451 10552 consensus_queue.cc:1035] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6991f49b0d5a48b08ad92795be6d8802" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 18:57:52.268811 10536 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 18:57:53.785682 9368 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:53.785800 9368 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:53.786595 9368 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 93732167cce947ff86de2c1206f4d335: Sending DeleteTablet for 3 replicas of tablet 6ef6f975fd4145a9a93d68f3b5ba6745
I20260811 18:57:53.786859 9916 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ef6f975fd4145a9a93d68f3b5ba6745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:53 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:42972
I20260811 18:57:53.786880 9629 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ef6f975fd4145a9a93d68f3b5ba6745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:53 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:58078
I20260811 18:57:53.786990 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 9503
I20260811 18:57:53.787463 10212 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ef6f975fd4145a9a93d68f3b5ba6745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:53 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:50714
I20260811 18:57:53.800186 10706 tablet_replica.cc:330] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249: stopping tablet replica
I20260811 18:57:53.800277 10706 raft_consensus.cc:2229] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:53.800348 10706 raft_consensus.cc:2258] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:53.800525 10702 tablet_replica.cc:330] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248: stopping tablet replica
I20260811 18:57:53.800594 10702 raft_consensus.cc:2229] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:57:53.800609 10706 ts_tablet_manager.cc:1905] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:53.800674 10702 raft_consensus.cc:2258] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:53.800920 10702 ts_tablet_manager.cc:1905] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:53.802415 10706 ts_tablet_manager.cc:1918] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:57:53.802479 10706 log.cc:1196] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/6ef6f975fd4145a9a93d68f3b5ba6745
I20260811 18:57:53.802503 10702 ts_tablet_manager.cc:1918] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:57:53.802582 10702 log.cc:1196] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/6ef6f975fd4145a9a93d68f3b5ba6745
I20260811 18:57:53.802676 10706 ts_tablet_manager.cc:1939] T 6ef6f975fd4145a9a93d68f3b5ba6745 P f886638c6cad4826bb3b426ee1c73249: Deleting consensus metadata
I20260811 18:57:53.802852 10702 ts_tablet_manager.cc:1939] T 6ef6f975fd4145a9a93d68f3b5ba6745 P 5683b6aba5124fd2baaad86d5d0bd248: Deleting consensus metadata
I20260811 18:57:53.803016 9347 catalog_manager.cc:4841] TS f886638c6cad4826bb3b426ee1c73249 (127.5.226.67:41839): tablet 6ef6f975fd4145a9a93d68f3b5ba6745 (table test-table [id=a84e86773d78482ebc38f4bd3337c4ac]) successfully deleted
I20260811 18:57:53.803181 9350 catalog_manager.cc:4841] TS 5683b6aba5124fd2baaad86d5d0bd248 (127.5.226.66:40343): tablet 6ef6f975fd4145a9a93d68f3b5ba6745 (table test-table [id=a84e86773d78482ebc38f4bd3337c4ac]) successfully deleted
W20260811 18:57:53.806666 9346 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:36777 (error 108)
I20260811 18:57:53.806741 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 9770
I20260811 18:57:53.816475 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:53.812945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:36777 (local address 127.0.0.1:58096)
0811 18:57:53.816358 (+ 3413us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:53.816428 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:36777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3380,"thread_start_us":74,"threads_started":1}
W20260811 18:57:53.816603 9346 catalog_manager.cc:4584] TS 6991f49b0d5a48b08ad92795be6d8802 (127.5.226.65:36777): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6ef6f975fd4145a9a93d68f3b5ba6745: Network error: Client connection negotiation failed: client connection to 127.5.226.65:36777: connect: Connection refused (error 111)
I20260811 18:57:53.824561 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 10073
I20260811 18:57:53.842617 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 9311
2026-08-11T18:57:53Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6000 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:53 dist-test-slave-gjw7 krb5kdc[10713](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:53 dist-test-slave-gjw7 krb5kdc[10713](info): set up 2 sockets
Aug 11 18:57:53 dist-test-slave-gjw7 krb5kdc[10713](info): commencing operation
krb5kdc: starting...
W20260811 18:57:55.068856 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:57:55 dist-test-slave-gjw7 krb5kdc[10713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 18:57:55.187870 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:38387
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:38387
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:55.269438 10743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:55.269641 10743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:55.269662 10743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:55.270816 10743 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:55.270859 10743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:55.270871 10743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:55.270882 10743 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:55.270895 10743 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:55.272406 10743 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:38387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:38387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:55.272642 10743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:55.272897 10743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:55.277601 10751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:55.277608 10753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:55.277613 10749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:55.277746 10743 server_base.cc:1034] running on GCE node
I20260811 18:57:55.278134 10743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:55.278409 10743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:55.279551 10743 hybrid_clock.cc:648] HybridClock initialized: now 1786474675279540 us; error 31 us; skew 500 ppm
Aug 11 18:57:55 dist-test-slave-gjw7 krb5kdc[10713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474675, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:55.282159 10743 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 18:57:55.282557 10743 webserver.cc:460] Webserver started at http://127.5.226.126:43979/ using document root <none> and password file <none>
I20260811 18:57:55.282761 10743 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:55.282800 10743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:55.282892 10743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:55.283900 10743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "8eb6c966e0e74f34980535311b42d1c3"
format_stamp: "Formatted at 2026-08-11 18:57:55 on dist-test-slave-gjw7"
server_key: "5a69a7d6347edaf3a2a9239acae36b4b"
server_key_iv: "ccd743d92a71748e80bd706e3d230b04"
server_key_version: "encryptionkey@0"
I20260811 18:57:55.284188 10743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "8eb6c966e0e74f34980535311b42d1c3"
format_stamp: "Formatted at 2026-08-11 18:57:55 on dist-test-slave-gjw7"
server_key: "5a69a7d6347edaf3a2a9239acae36b4b"
server_key_iv: "ccd743d92a71748e80bd706e3d230b04"
server_key_version: "encryptionkey@0"
I20260811 18:57:55.285386 10743 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:55.286036 10766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:55.286170 10743 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:55.286257 10743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "8eb6c966e0e74f34980535311b42d1c3"
format_stamp: "Formatted at 2026-08-11 18:57:55 on dist-test-slave-gjw7"
server_key: "5a69a7d6347edaf3a2a9239acae36b4b"
server_key_iv: "ccd743d92a71748e80bd706e3d230b04"
server_key_version: "encryptionkey@0"
I20260811 18:57:55.286314 10743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:55.296301 10743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:55.298851 10743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:55.299003 10743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:55.303363 10743 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:38387
I20260811 18:57:55.303395 10884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:38387 every 8 connection(s)
I20260811 18:57:55.303740 10743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:55.304592 10887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:55.306847 10887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3: Bootstrap starting.
I20260811 18:57:55.307360 10887 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:55.307585 10887 log.cc:824] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:55.308295 10887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3: No bootstrap required, opened a new log
I20260811 18:57:55.309926 10887 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eb6c966e0e74f34980535311b42d1c3" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38387 } }
I20260811 18:57:55.310063 10887 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:55.310086 10887 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eb6c966e0e74f34980535311b42d1c3, State: Initialized, Role: FOLLOWER
I20260811 18:57:55.310195 10887 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eb6c966e0e74f34980535311b42d1c3" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38387 } }
I20260811 18:57:55.310271 10887 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:55.310293 10887 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:55.310326 10887 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:55.310791 10887 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eb6c966e0e74f34980535311b42d1c3" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38387 } }
I20260811 18:57:55.310879 10887 leader_election.cc:302] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8eb6c966e0e74f34980535311b42d1c3; no voters:
I20260811 18:57:55.311005 10887 leader_election.cc:288] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:55.311058 10890 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:55.311231 10887 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:55.311244 10890 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [term 1 LEADER]: Becoming Leader. State: Replica: 8eb6c966e0e74f34980535311b42d1c3, State: Running, Role: LEADER
I20260811 18:57:55.311386 10890 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eb6c966e0e74f34980535311b42d1c3" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38387 } }
I20260811 18:57:55.311928 10892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8eb6c966e0e74f34980535311b42d1c3. Latest consensus state: current_term: 1 leader_uuid: "8eb6c966e0e74f34980535311b42d1c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eb6c966e0e74f34980535311b42d1c3" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38387 } } }
I20260811 18:57:55.311937 10891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8eb6c966e0e74f34980535311b42d1c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eb6c966e0e74f34980535311b42d1c3" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38387 } } }
I20260811 18:57:55.312028 10892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:55.312037 10891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:55.312222 10903 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:55.312748 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 10743
I20260811 18:57:55.312834 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:57:55.312994 6025 external_mini_cluster.cc:1428] Setting key 70438dfc1e54f0d9888309b0e0c94161
I20260811 18:57:55.313386 10903 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:55.314925 10903 catalog_manager.cc:1347] Generated new cluster ID: 7e66ed149cfa4286b5a3aae195af52b2
I20260811 18:57:55.314976 10903 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:57:55 dist-test-slave-gjw7 krb5kdc[10713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:55.324684 10917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:55.313429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54658 (local address 127.5.226.126:38387)
0811 18:57:55.313580 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:55.313590 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:55.314170 (+ 580us) server_negotiation.cc:407] Connection header received
0811 18:57:55.314284 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:55.314291 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:55.314333 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:55.314458 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:55.315236 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:55.316620 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:55.317724 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:55.318318 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:55.318411 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:55.321094 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:55.321098 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:55.321099 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:55.321112 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:55.323054 (+ 1942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:55.323447 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:55.323450 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:55.323451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:55.323563 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:55.323735 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:55.323736 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:55.323736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:55.324051 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:55.324234 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:55.324305 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 18:57:55.324446 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":78,"threads_started":1}
I20260811 18:57:55.345865 10903 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:55.346634 10903 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:55.355882 10903 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8eb6c966e0e74f34980535311b42d1c3: Generated new TSK 0
I20260811 18:57:55.356073 10903 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 18:57:55.387848 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:38387
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:55.468578 10930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:55.468847 10930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:55.468871 10930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:55.470055 10930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:55.470096 10930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:55.470124 10930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:57:55.471530 10930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:38387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:55.471755 10930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:55.471969 10930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:55.476756 10946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:55.476784 10943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:55.476800 10940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:55.477046 10930 server_base.cc:1034] running on GCE node
I20260811 18:57:55.477211 10930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:55.477443 10930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:55.478592 10930 hybrid_clock.cc:648] HybridClock initialized: now 1786474675478576 us; error 29 us; skew 500 ppm
Aug 11 18:57:55 dist-test-slave-gjw7 krb5kdc[10713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474675, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:55.480999 10930 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 18:57:55.481422 10930 webserver.cc:460] Webserver started at http://127.5.226.65:35707/ using document root <none> and password file <none>
I20260811 18:57:55.481619 10930 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:55.481659 10930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:55.481760 10930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:55.482720 10930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "c8e7679a677148f2982b941eaa840ddd"
format_stamp: "Formatted at 2026-08-11 18:57:55 on dist-test-slave-gjw7"
server_key: "7071a18b3124f81ba0349224da8edfdc"
server_key_iv: "3adbc0d466060eafeef23fbebc02acf9"
server_key_version: "encryptionkey@0"
I20260811 18:57:55.483026 10930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "c8e7679a677148f2982b941eaa840ddd"
format_stamp: "Formatted at 2026-08-11 18:57:55 on dist-test-slave-gjw7"
server_key: "7071a18b3124f81ba0349224da8edfdc"
server_key_iv: "3adbc0d466060eafeef23fbebc02acf9"
server_key_version: "encryptionkey@0"
I20260811 18:57:55.484160 10930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:57:55.484756 10961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:55.484905 10930 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:55.484990 10930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "c8e7679a677148f2982b941eaa840ddd"
format_stamp: "Formatted at 2026-08-11 18:57:55 on dist-test-slave-gjw7"
server_key: "7071a18b3124f81ba0349224da8edfdc"
server_key_iv: "3adbc0d466060eafeef23fbebc02acf9"
server_key_version: "encryptionkey@0"
I20260811 18:57:55.485049 10930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:55.499827 10930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:55.501479 10930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:55.501610 10930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:55.501818 10930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:55.502105 10930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:55.502139 10930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:55.502166 10930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:55.502183 10930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:55.507719 10930 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:40031
I20260811 18:57:55.507772 11186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:40031 every 8 connection(s)
I20260811 18:57:55.508055 10930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 18:57:55.512861 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 10930
I20260811 18:57:55.512950 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:57:55.513144 6025 external_mini_cluster.cc:1428] Setting key 5a5b8ba11b0ed2318a1eb80ef0a4f5f6
Aug 11 18:57:55 dist-test-slave-gjw7 krb5kdc[10713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474675, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:55.517235 10917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:55.508716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:46179 (local address 127.5.226.126:38387)
0811 18:57:55.508759 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:55.508761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:55.508975 (+ 214us) server_negotiation.cc:407] Connection header received
0811 18:57:55.509554 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:55.509555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:55.509572 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:55.509624 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:55.510539 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:55.511046 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:55.512124 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:55.512361 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:55.512420 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:55.514627 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:55.514629 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:55.514629 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:55.514637 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:55.516006 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:55.516387 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:55.516388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:55.516389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:55.516453 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:55.516656 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:55.516656 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:55.516657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:55.516789 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:55.516849 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:55.517064 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 18:57:55.517151 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:57:55.517329 11189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:55.508689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:38387 (local address 127.5.226.65:46179)
0811 18:57:55.508862 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:55.508899 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:55.509455 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:55.509695 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:55.509700 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:55.510254 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:55.510442 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:55.510447 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:55.511156 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:55.511158 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:55.512049 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:55.512052 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:55.512439 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:55.512440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:55.512568 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:55.513070 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:55.513080 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:55.514542 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:55.516098 (+ 1556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:55.516105 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:55.516107 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:55.516323 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:55.516514 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:55.516515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:55.516515 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:55.516603 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:55.516846 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:55.516849 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:55.516953 (+ 104us) client_negotiation.cc:769] Sending connection context
0811 18:57:55.517026 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 18:57:55.517137 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":94,"threads_started":1}
I20260811 18:57:55.517784 11187 heartbeater.cc:347] Connected to a master server at 127.5.226.126:38387
I20260811 18:57:55.517897 11187 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:55.518105 11187 heartbeater.cc:511] Master 127.5.226.126:38387 requested a full tablet report, sending...
I20260811 18:57:55.518620 10815 ts_manager.cc:194] Registered new tserver with Master: c8e7679a677148f2982b941eaa840ddd (127.5.226.65:40031)
I20260811 18:57:55.519240 10815 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:46179
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 18:57:55.538259 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:38387
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:55.618865 11195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:55.619072 11195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:55.619105 11195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:55.620265 11195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:55.620309 11195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:55.620344 11195 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:57:55.621785 11195 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:38387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:55.622016 11195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:55.622234 11195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:55.626983 11204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:55.627027 11202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:55.626983 11206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:55.627236 11195 server_base.cc:1034] running on GCE node
I20260811 18:57:55.627449 11195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:55.627667 11195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:55.628799 11195 hybrid_clock.cc:648] HybridClock initialized: now 1786474675628782 us; error 34 us; skew 500 ppm
Aug 11 18:57:55 dist-test-slave-gjw7 krb5kdc[10713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474675, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:55.631276 11195 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 18:57:55.631686 11195 webserver.cc:460] Webserver started at http://127.5.226.66:37819/ using document root <none> and password file <none>
I20260811 18:57:55.631880 11195 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:55.631927 11195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:55.632053 11195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:55.633097 11195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "2a5c901b45ad43679b06907ee3e77cac"
format_stamp: "Formatted at 2026-08-11 18:57:55 on dist-test-slave-gjw7"
server_key: "8435e211a7c71d1b80c14ee6db81d7d6"
server_key_iv: "01a23000bfd0fcd2b743516ca26d5a3c"
server_key_version: "encryptionkey@0"
I20260811 18:57:55.633460 11195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "2a5c901b45ad43679b06907ee3e77cac"
format_stamp: "Formatted at 2026-08-11 18:57:55 on dist-test-slave-gjw7"
server_key: "8435e211a7c71d1b80c14ee6db81d7d6"
server_key_iv: "01a23000bfd0fcd2b743516ca26d5a3c"
server_key_version: "encryptionkey@0"
I20260811 18:57:55.634714 11195 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:55.635368 11219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:55.635536 11195 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:57:55.635623 11195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "2a5c901b45ad43679b06907ee3e77cac"
format_stamp: "Formatted at 2026-08-11 18:57:55 on dist-test-slave-gjw7"
server_key: "8435e211a7c71d1b80c14ee6db81d7d6"
server_key_iv: "01a23000bfd0fcd2b743516ca26d5a3c"
server_key_version: "encryptionkey@0"
I20260811 18:57:55.635681 11195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:55.650338 11195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:55.652341 11195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:55.652469 11195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:55.652673 11195 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:55.652954 11195 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:55.652988 11195 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:55.653014 11195 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:55.653038 11195 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:55.658563 11195 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:34839
I20260811 18:57:55.658641 11438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:34839 every 8 connection(s)
I20260811 18:57:55.658901 11195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 18:57:55.662832 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 11195
I20260811 18:57:55.662935 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:57:55.663125 6025 external_mini_cluster.cc:1428] Setting key ae1fc83b8ded3731aaeb64ccf1abfdfc
Aug 11 18:57:55 dist-test-slave-gjw7 krb5kdc[10713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474675, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:55.667721 10917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:55.659579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:41931 (local address 127.5.226.126:38387)
0811 18:57:55.659644 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:55.659646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:55.659836 (+ 190us) server_negotiation.cc:407] Connection header received
0811 18:57:55.660290 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:55.660291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:55.660303 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:55.660354 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:55.661232 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:55.661804 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:55.662729 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:55.663011 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:55.663086 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:55.665206 (+ 2120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:55.665208 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:55.665209 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:55.665218 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:55.666431 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:55.666888 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:55.666889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:55.666889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:55.666954 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:55.667152 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:55.667153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:55.667154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:55.667288 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:55.667351 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:55.667554 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 18:57:55.667637 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 18:57:55.667804 11449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:55.659552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:38387 (local address 127.5.226.66:41931)
0811 18:57:55.659720 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:55.659754 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:55.660211 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:55.660412 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:55.660416 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:55.660943 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:55.661123 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:55.661127 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:55.661876 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:55.661877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:55.662654 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:55.662656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:55.663094 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:55.663095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:55.663196 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:55.663649 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:55.663657 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:55.665121 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:55.666505 (+ 1384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:55.666514 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:55.666516 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:55.666814 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:55.667013 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:55.667013 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:55.667014 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:55.667104 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:55.667342 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:55.667344 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:55.667447 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 18:57:55.667519 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 18:57:55.667633 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
I20260811 18:57:55.668269 11439 heartbeater.cc:347] Connected to a master server at 127.5.226.126:38387
I20260811 18:57:55.668380 11439 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:55.668551 11439 heartbeater.cc:511] Master 127.5.226.126:38387 requested a full tablet report, sending...
I20260811 18:57:55.668952 10815 ts_manager.cc:194] Registered new tserver with Master: 2a5c901b45ad43679b06907ee3e77cac (127.5.226.66:34839)
I20260811 18:57:55.669492 10815 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:41931
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 18:57:55.689766 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:38387
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:55.771306 11454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:55.771504 11454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:55.771526 11454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:55.772655 11454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:55.772696 11454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:55.772740 11454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:57:55.774178 11454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:38387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:55.774394 11454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:55.774597 11454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:55.779711 11469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:55.779760 11466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:55.779733 11465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:55.779884 11454 server_base.cc:1034] running on GCE node
I20260811 18:57:55.780068 11454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:55.780290 11454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:55.781428 11454 hybrid_clock.cc:648] HybridClock initialized: now 1786474675781414 us; error 29 us; skew 500 ppm
Aug 11 18:57:55 dist-test-slave-gjw7 krb5kdc[10713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474675, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:55.783700 11454 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 18:57:55.784140 11454 webserver.cc:460] Webserver started at http://127.5.226.67:44771/ using document root <none> and password file <none>
I20260811 18:57:55.784358 11454 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:55.784406 11454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:55.784534 11454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:55.785607 11454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "6ca238a6e8d54fc4af89279deda2d4b3"
format_stamp: "Formatted at 2026-08-11 18:57:55 on dist-test-slave-gjw7"
server_key: "e85c79c675ebf138f6c67f3832ab5fc4"
server_key_iv: "97b08cc7040a7cae657d7ba1866d8953"
server_key_version: "encryptionkey@0"
I20260811 18:57:55.785955 11454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "6ca238a6e8d54fc4af89279deda2d4b3"
format_stamp: "Formatted at 2026-08-11 18:57:55 on dist-test-slave-gjw7"
server_key: "e85c79c675ebf138f6c67f3832ab5fc4"
server_key_iv: "97b08cc7040a7cae657d7ba1866d8953"
server_key_version: "encryptionkey@0"
I20260811 18:57:55.787251 11454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:57:55.787882 11479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:55.788055 11454 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:55.788142 11454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "6ca238a6e8d54fc4af89279deda2d4b3"
format_stamp: "Formatted at 2026-08-11 18:57:55 on dist-test-slave-gjw7"
server_key: "e85c79c675ebf138f6c67f3832ab5fc4"
server_key_iv: "97b08cc7040a7cae657d7ba1866d8953"
server_key_version: "encryptionkey@0"
I20260811 18:57:55.788218 11454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:55.798971 11454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:55.800598 11454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:55.800725 11454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:55.800922 11454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:55.801196 11454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:55.801236 11454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:55.801265 11454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:55.801307 11454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:55.806785 11454 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:41489
I20260811 18:57:55.806843 11692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:41489 every 8 connection(s)
I20260811 18:57:55.807111 11454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
Aug 11 18:57:55 dist-test-slave-gjw7 krb5kdc[10713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474675, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:55.814911 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 11454
I20260811 18:57:55.815002 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:57:55.815181 6025 external_mini_cluster.cc:1428] Setting key c27653ec5fc1db12dcec5512188175ee
I20260811 18:57:55.815678 10917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:55.807735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:35257 (local address 127.5.226.126:38387)
0811 18:57:55.807812 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:55.807814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:55.807964 (+ 150us) server_negotiation.cc:407] Connection header received
0811 18:57:55.808472 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:55.808474 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:55.808483 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:55.808533 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:55.809429 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:55.809929 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:55.810861 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:55.811037 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:55.811081 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:55.813138 (+ 2057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:55.813140 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:55.813141 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:55.813148 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:55.814334 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:55.814710 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:55.814711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:55.814712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:55.814766 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:55.814982 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:55.814983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:55.814983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:55.815121 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:55.815181 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:55.815496 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 18:57:55.815580 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 18:57:55.815850 11700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:55.807708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:38387 (local address 127.5.226.67:35257)
0811 18:57:55.807855 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:55.807889 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:55.808391 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:55.808587 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:55.808591 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:55.809125 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:55.809348 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:55.809355 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:55.809991 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:55.809992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:55.810801 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:55.810804 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:55.811104 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:55.811105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:55.811208 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:55.811702 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:55.811712 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:55.813043 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:55.814412 (+ 1369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:55.814420 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:55.814422 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:55.814633 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:55.814820 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:55.814821 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:55.814821 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:55.814925 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:55.815182 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:55.815191 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:55.815348 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 18:57:55.815451 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 18:57:55.815623 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":83,"threads_started":1}
I20260811 18:57:55.816300 11696 heartbeater.cc:347] Connected to a master server at 127.5.226.126:38387
I20260811 18:57:55.816386 11696 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:55.816527 11696 heartbeater.cc:511] Master 127.5.226.126:38387 requested a full tablet report, sending...
I20260811 18:57:55.816838 10815 ts_manager.cc:194] Registered new tserver with Master: 6ca238a6e8d54fc4af89279deda2d4b3 (127.5.226.67:41489)
I20260811 18:57:55.817212 10815 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:35257
I20260811 18:57:55.826934 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 18:57:55.839639 10917 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:55.838736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54670 (local address 127.5.226.126:38387)
0811 18:57:55.838806 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:55.838808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:55.838884 (+ 76us) server_negotiation.cc:407] Connection header received
0811 18:57:55.838937 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:55.838938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:55.838947 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:55.838995 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:55.839574 (+ 579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54670: BlockingRecv error: recv got EOF from 127.0.0.1:54670 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 18:57:55.840512 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 10930
I20260811 18:57:55.854230 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 11195
I20260811 18:57:55.864847 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 11454
I20260811 18:57:55.885155 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 10743
2026-08-11T18:57:55Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2031 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:55 dist-test-slave-gjw7 krb5kdc[11719](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:55 dist-test-slave-gjw7 krb5kdc[11719](info): set up 2 sockets
Aug 11 18:57:55 dist-test-slave-gjw7 krb5kdc[11719](info): commencing operation
krb5kdc: starting...
W20260811 18:57:57.108922 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:57:57 dist-test-slave-gjw7 krb5kdc[11719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 18:57:57.231484 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:42353
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:42353
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:57.316540 11740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:57.316762 11740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:57.316787 11740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:57.317982 11740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:57.318032 11740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:57.318046 11740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:57.318059 11740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:57.318073 11740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:57.319620 11740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:42353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:42353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:57.319860 11740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:57.320072 11740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:57.324918 11754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:57.324934 11748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:57.325112 11740 server_base.cc:1034] running on GCE node
W20260811 18:57:57.324934 11757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:57.325482 11740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:57.325762 11740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:57.326907 11740 hybrid_clock.cc:648] HybridClock initialized: now 1786474677326893 us; error 29 us; skew 500 ppm
Aug 11 18:57:57 dist-test-slave-gjw7 krb5kdc[11719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474677, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:57.332439 11740 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 18:57:57.332883 11740 webserver.cc:460] Webserver started at http://127.5.226.126:35101/ using document root <none> and password file <none>
I20260811 18:57:57.333094 11740 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:57.333140 11740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:57.333269 11740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:57.334384 11740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "be87623f0de642fd934bd91f92217a00"
format_stamp: "Formatted at 2026-08-11 18:57:57 on dist-test-slave-gjw7"
server_key: "ab3717ad09e694d476315a978c8b3dcb"
server_key_iv: "bca163c6f606077204a8de40f95dd183"
server_key_version: "encryptionkey@0"
I20260811 18:57:57.334712 11740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "be87623f0de642fd934bd91f92217a00"
format_stamp: "Formatted at 2026-08-11 18:57:57 on dist-test-slave-gjw7"
server_key: "ab3717ad09e694d476315a978c8b3dcb"
server_key_iv: "bca163c6f606077204a8de40f95dd183"
server_key_version: "encryptionkey@0"
I20260811 18:57:57.335969 11740 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:57:57.336726 11772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:57.336938 11740 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:57.337044 11740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "be87623f0de642fd934bd91f92217a00"
format_stamp: "Formatted at 2026-08-11 18:57:57 on dist-test-slave-gjw7"
server_key: "ab3717ad09e694d476315a978c8b3dcb"
server_key_iv: "bca163c6f606077204a8de40f95dd183"
server_key_version: "encryptionkey@0"
I20260811 18:57:57.337111 11740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:57.354301 11740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:57.356150 11740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:57.356273 11740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:57.360239 11740 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:42353
I20260811 18:57:57.360282 11869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:42353 every 8 connection(s)
I20260811 18:57:57.360622 11740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:57.361575 11871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:57.364176 11871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00: Bootstrap starting.
I20260811 18:57:57.364831 11871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:57.365114 11871 log.cc:824] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:57.365882 11871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00: No bootstrap required, opened a new log
I20260811 18:57:57.366837 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 11740
I20260811 18:57:57.366986 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:57:57.367182 6025 external_mini_cluster.cc:1428] Setting key 811d3d8723ccbefe5c1b70bda6a117e1
I20260811 18:57:57.368594 11871 raft_consensus.cc:348] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be87623f0de642fd934bd91f92217a00" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42353 } }
I20260811 18:57:57.368789 11871 raft_consensus.cc:374] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:57.368830 11871 raft_consensus.cc:729] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be87623f0de642fd934bd91f92217a00, State: Initialized, Role: FOLLOWER
I20260811 18:57:57.369000 11871 consensus_queue.cc:260] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be87623f0de642fd934bd91f92217a00" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42353 } }
I20260811 18:57:57.369084 11871 raft_consensus.cc:388] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:57.369108 11871 raft_consensus.cc:482] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:57.369158 11871 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:57.369917 11871 raft_consensus.cc:504] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be87623f0de642fd934bd91f92217a00" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42353 } }
I20260811 18:57:57.370036 11871 leader_election.cc:302] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be87623f0de642fd934bd91f92217a00; no voters:
I20260811 18:57:57.370204 11871 leader_election.cc:288] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:57.370255 11878 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:57.370471 11878 raft_consensus.cc:686] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [term 1 LEADER]: Becoming Leader. State: Replica: be87623f0de642fd934bd91f92217a00, State: Running, Role: LEADER
I20260811 18:57:57.370477 11871 sys_catalog.cc:564] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:57.370667 11878 consensus_queue.cc:237] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be87623f0de642fd934bd91f92217a00" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42353 } }
I20260811 18:57:57.371088 11883 sys_catalog.cc:455] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be87623f0de642fd934bd91f92217a00. Latest consensus state: current_term: 1 leader_uuid: "be87623f0de642fd934bd91f92217a00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be87623f0de642fd934bd91f92217a00" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42353 } } }
I20260811 18:57:57.371111 11879 sys_catalog.cc:455] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be87623f0de642fd934bd91f92217a00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be87623f0de642fd934bd91f92217a00" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42353 } } }
I20260811 18:57:57.371239 11879 sys_catalog.cc:458] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:57.371461 11883 sys_catalog.cc:458] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:57.371459 11900 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:57.372165 11900 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:57.374257 11900 catalog_manager.cc:1347] Generated new cluster ID: 314a955015eb4fd8b85a6f9add68f8db
I20260811 18:57:57.374317 11900 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:57:57 dist-test-slave-gjw7 krb5kdc[11719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:57.378268 11877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:57.367719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53414 (local address 127.5.226.126:42353)
0811 18:57:57.367959 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:57.367972 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:57.368018 (+ 46us) server_negotiation.cc:407] Connection header received
0811 18:57:57.368554 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:57.368564 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:57.368637 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:57.368801 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:57.369539 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:57.370919 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:57.371985 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:57.372608 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:57.372699 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:57.375278 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:57.375282 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:57.375283 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:57.375296 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:57.376817 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:57.377145 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:57.377149 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:57.377149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:57.377249 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:57.377447 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:57.377448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:57.377448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:57.377698 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:57.377827 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:57.377950 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 18:57:57.378096 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":104,"threads_started":1}
I20260811 18:57:57.379210 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:57.394023 11877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:57.390806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53418 (local address 127.5.226.126:42353)
0811 18:57:57.390852 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:57.390855 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:57.390955 (+ 100us) server_negotiation.cc:407] Connection header received
0811 18:57:57.391019 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:57.391020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:57.391031 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:57.391079 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:57.391459 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:57.391946 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:57.392643 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:57.392850 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:57.392905 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:57.393574 (+ 669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:57.393576 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:57.393576 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:57.393780 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:57.393798 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:57.393804 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:57.393854 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:57.393917 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 18:57:57.393943 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:57:57.395655 11900 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:57.396201 11900 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:57.401978 11900 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be87623f0de642fd934bd91f92217a00: Generated new TSK 0
I20260811 18:57:57.402163 11900 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:57.405861 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 11740
2026-08-11T18:57:57Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1539 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:57 dist-test-slave-gjw7 krb5kdc[11936](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:57 dist-test-slave-gjw7 krb5kdc[11936](info): set up 2 sockets
Aug 11 18:57:57 dist-test-slave-gjw7 krb5kdc[11936](info): commencing operation
krb5kdc: starting...
W20260811 18:57:58.659324 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:57:58 dist-test-slave-gjw7 krb5kdc[11936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 18:57:58.784725 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:40979
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:33993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:40979
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:58.870065 11969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:58.870296 11969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:58.870328 11969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:58.871503 11969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:58.871544 11969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:58.871562 11969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:58.871577 11969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:58.871591 11969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:58.873174 11969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:33993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:40979
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:40979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:58.873464 11969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:58.873705 11969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:58.879102 11985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:58.879102 11995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:58.879133 11988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:58.879415 11969 server_base.cc:1034] running on GCE node
I20260811 18:57:58.879693 11969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:58.880039 11969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:58.881201 11969 hybrid_clock.cc:648] HybridClock initialized: now 1786474678881178 us; error 43 us; skew 500 ppm
Aug 11 18:57:58 dist-test-slave-gjw7 krb5kdc[11936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474678, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:58.884032 11969 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 18:57:58.884543 11969 webserver.cc:460] Webserver started at http://127.5.226.126:38559/ using document root <none> and password file <none>
I20260811 18:57:58.884776 11969 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:58.884831 11969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:58.884989 11969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:58.886304 11969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "1c8f1b3994f640aba9ca4b1f163628a2"
format_stamp: "Formatted at 2026-08-11 18:57:58 on dist-test-slave-gjw7"
server_key: "62aafbd06498272cf3f2370faaab971a"
server_key_iv: "f0059b0372ca1af3d44de501839681b3"
server_key_version: "encryptionkey@0"
I20260811 18:57:58.886701 11969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "1c8f1b3994f640aba9ca4b1f163628a2"
format_stamp: "Formatted at 2026-08-11 18:57:58 on dist-test-slave-gjw7"
server_key: "62aafbd06498272cf3f2370faaab971a"
server_key_iv: "f0059b0372ca1af3d44de501839681b3"
server_key_version: "encryptionkey@0"
I20260811 18:57:58.888196 11969 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:57:58.889070 12005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:58.889357 11969 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:58.889470 11969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "1c8f1b3994f640aba9ca4b1f163628a2"
format_stamp: "Formatted at 2026-08-11 18:57:58 on dist-test-slave-gjw7"
server_key: "62aafbd06498272cf3f2370faaab971a"
server_key_iv: "f0059b0372ca1af3d44de501839681b3"
server_key_version: "encryptionkey@0"
I20260811 18:57:58.889549 11969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:58.901727 11969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:58.904194 11969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:58.904405 11969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:58.908767 11969 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:40979
I20260811 18:57:58.908821 12120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:40979 every 8 connection(s)
I20260811 18:57:58.909204 11969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:58.910399 12121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:58.910842 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 11969
I20260811 18:57:58.910931 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:57:58.911119 6025 external_mini_cluster.cc:1428] Setting key 4880d1fa4eb20d06d9d81d258081bd30
I20260811 18:57:58.913681 12121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2: Bootstrap starting.
I20260811 18:57:58.914629 12121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:58.914956 12121 log.cc:824] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:58.915707 12121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2: No bootstrap required, opened a new log
Aug 11 18:57:58 dist-test-slave-gjw7 krb5kdc[11936](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:58.918617 12121 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8f1b3994f640aba9ca4b1f163628a2" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40979 } }
I20260811 18:57:58.918929 12121 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:58.919024 12121 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c8f1b3994f640aba9ca4b1f163628a2, State: Initialized, Role: FOLLOWER
I20260811 18:57:58.919354 12121 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8f1b3994f640aba9ca4b1f163628a2" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40979 } }
I20260811 18:57:58.919528 12121 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:58.919597 12121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:58.919704 12121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:58.920832 12121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8f1b3994f640aba9ca4b1f163628a2" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40979 } }
I20260811 18:57:58.920958 12121 leader_election.cc:302] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c8f1b3994f640aba9ca4b1f163628a2; no voters:
I20260811 18:57:58.921188 12121 leader_election.cc:288] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:58.921244 12133 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:58.921481 12133 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [term 1 LEADER]: Becoming Leader. State: Replica: 1c8f1b3994f640aba9ca4b1f163628a2, State: Running, Role: LEADER
I20260811 18:57:58.921602 12121 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:58.921628 12133 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8f1b3994f640aba9ca4b1f163628a2" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40979 } }
I20260811 18:57:58.921993 12133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c8f1b3994f640aba9ca4b1f163628a2. Latest consensus state: current_term: 1 leader_uuid: "1c8f1b3994f640aba9ca4b1f163628a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8f1b3994f640aba9ca4b1f163628a2" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40979 } } }
I20260811 18:57:58.922216 12133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:58.922148 12136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c8f1b3994f640aba9ca4b1f163628a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8f1b3994f640aba9ca4b1f163628a2" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40979 } } }
I20260811 18:57:58.922482 12136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:58.922730 12148 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:58.923221 12131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:58.911764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39970 (local address 127.5.226.126:40979)
0811 18:57:58.911968 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:58.911979 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:58.912017 (+ 38us) server_negotiation.cc:407] Connection header received
0811 18:57:58.912549 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:58.912558 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:58.912625 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:58.912788 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:58.913436 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:58.914762 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:58.915571 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:58.916180 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:58.916308 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:58.918930 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:58.918935 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:58.918936 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:58.918950 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:58.920939 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:58.921398 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:58.921403 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:58.921404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:58.921524 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:58.921753 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:58.921754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:58.921755 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:58.922103 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:58.922292 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:58.922826 (+ 534us) server_negotiation.cc:299] Negotiation successful
0811 18:57:58.922987 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":93,"threads_started":1}
I20260811 18:57:58.923367 12148 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:58.925004 12148 catalog_manager.cc:1347] Generated new cluster ID: 7002a7c9584d4b81abf39f7cde759771
I20260811 18:57:58.925065 12148 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:58.936605 12148 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:58.937202 12148 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:58.942842 12148 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c8f1b3994f640aba9ca4b1f163628a2: Generated new TSK 0
I20260811 18:57:58.943063 12148 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 18:57:58.970657 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40979
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:33993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:59.056488 12167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:59.056730 12167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:59.056767 12167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:59.058007 12167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:59.058060 12167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:59.058099 12167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:57:59.059633 12167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:33993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40979
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:59.059883 12167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:59.060133 12167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:59.065204 12177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:59.065169 12179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:59.065177 12175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:59.065400 12167 server_base.cc:1034] running on GCE node
I20260811 18:57:59.065675 12167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:59.065953 12167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:59.067123 12167 hybrid_clock.cc:648] HybridClock initialized: now 1786474679067109 us; error 32 us; skew 500 ppm
Aug 11 18:57:59 dist-test-slave-gjw7 krb5kdc[11936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474679, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:59.069748 12167 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 18:57:59.070176 12167 webserver.cc:460] Webserver started at http://127.5.226.65:46063/ using document root <none> and password file <none>
I20260811 18:57:59.070421 12167 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:59.070467 12167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:59.070564 12167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:59.071593 12167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "8fa0338c2d6b470a926361041f301b34"
format_stamp: "Formatted at 2026-08-11 18:57:59 on dist-test-slave-gjw7"
server_key: "8dd7b0c0e7756bfdcf5ee7915faca291"
server_key_iv: "ee5436dee300b436de727d030cf60015"
server_key_version: "encryptionkey@0"
I20260811 18:57:59.071911 12167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "8fa0338c2d6b470a926361041f301b34"
format_stamp: "Formatted at 2026-08-11 18:57:59 on dist-test-slave-gjw7"
server_key: "8dd7b0c0e7756bfdcf5ee7915faca291"
server_key_iv: "ee5436dee300b436de727d030cf60015"
server_key_version: "encryptionkey@0"
I20260811 18:57:59.073164 12167 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:57:59.073987 12197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:59.074180 12167 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:59.074295 12167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "8fa0338c2d6b470a926361041f301b34"
format_stamp: "Formatted at 2026-08-11 18:57:59 on dist-test-slave-gjw7"
server_key: "8dd7b0c0e7756bfdcf5ee7915faca291"
server_key_iv: "ee5436dee300b436de727d030cf60015"
server_key_version: "encryptionkey@0"
I20260811 18:57:59.074376 12167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:59.085994 12167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:59.088248 12167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:59.088409 12167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:59.088667 12167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:59.089020 12167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:59.089057 12167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:59.089088 12167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:59.089111 12167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:59.095075 12167 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:34921
I20260811 18:57:59.095118 12407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:34921 every 8 connection(s)
I20260811 18:57:59.095471 12167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 18:57:59.096802 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 12167
I20260811 18:57:59.096885 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:57:59.097065 6025 external_mini_cluster.cc:1428] Setting key a7fd9aeacd5f41d7e574cdbb758688bb
Aug 11 18:57:59 dist-test-slave-gjw7 krb5kdc[11936](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474679, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:59.105378 12131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:59.096322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:34531 (local address 127.5.226.126:40979)
0811 18:57:59.096387 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:59.096389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:59.096553 (+ 164us) server_negotiation.cc:407] Connection header received
0811 18:57:59.097168 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:59.097170 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:59.097183 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:59.097210 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:59.098497 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:59.099007 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:59.100029 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:59.100242 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:59.100309 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:59.102556 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:59.102558 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:59.102558 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:59.102568 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:59.103979 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:59.104369 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:59.104370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:59.104371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:59.104433 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:59.104663 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:59.104664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:59.104665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:59.104788 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:59.104847 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:59.105127 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 18:57:59.105238 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 18:57:59.105535 12410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:59.096246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40979 (local address 127.5.226.65:34531)
0811 18:57:59.096432 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:59.096473 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:59.097039 (+ 566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:59.097454 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:59.097460 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:59.098171 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:59.098386 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:59.098392 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:59.099100 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:59.099102 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:59.099935 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:59.099938 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:59.100319 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:59.100321 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:59.100460 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:59.100976 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:59.100985 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:59.102402 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:59.104059 (+ 1657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:59.104067 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:59.104070 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:59.104301 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:59.104488 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:59.104489 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:59.104489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:59.104607 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:59.104846 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:59.104854 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:59.105002 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 18:57:59.105095 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 18:57:59.105269 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":93,"threads_started":1}
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
I20260811 18:57:59.106047 12408 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40979
I20260811 18:57:59.106151 12408 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:59.106354 12408 heartbeater.cc:511] Master 127.5.226.126:40979 requested a full tablet report, sending...
I20260811 18:57:59.106983 12041 ts_manager.cc:194] Registered new tserver with Master: 8fa0338c2d6b470a926361041f301b34 (127.5.226.65:34921)
I20260811 18:57:59.107617 12041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:34531
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 18:57:59.124635 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40979
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:33993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:59.208066 12416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:59.208303 12416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:59.208339 12416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:59.209544 12416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:59.209586 12416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:59.209621 12416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:57:59.211117 12416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:33993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40979
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:59.211378 12416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:59.211596 12416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:59.216558 12432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:59.216559 12426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:59.216754 12416 server_base.cc:1034] running on GCE node
W20260811 18:57:59.216553 12427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:59.217082 12416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:59.217336 12416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:59.218482 12416 hybrid_clock.cc:648] HybridClock initialized: now 1786474679218470 us; error 28 us; skew 500 ppm
Aug 11 18:57:59 dist-test-slave-gjw7 krb5kdc[11936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474679, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:59.221084 12416 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 18:57:59.221606 12416 webserver.cc:460] Webserver started at http://127.5.226.66:43711/ using document root <none> and password file <none>
I20260811 18:57:59.221849 12416 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:59.221897 12416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:59.222013 12416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:59.223181 12416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "630ee414895943c7918e4fa280a220bc"
format_stamp: "Formatted at 2026-08-11 18:57:59 on dist-test-slave-gjw7"
server_key: "b7660244264c27362c2aae1f347698db"
server_key_iv: "24ff8c3a840c3021eeb6d2e057f41c3c"
server_key_version: "encryptionkey@0"
I20260811 18:57:59.223520 12416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "630ee414895943c7918e4fa280a220bc"
format_stamp: "Formatted at 2026-08-11 18:57:59 on dist-test-slave-gjw7"
server_key: "b7660244264c27362c2aae1f347698db"
server_key_iv: "24ff8c3a840c3021eeb6d2e057f41c3c"
server_key_version: "encryptionkey@0"
I20260811 18:57:59.224867 12416 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:57:59.225605 12444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:59.225759 12416 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:57:59.225860 12416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "630ee414895943c7918e4fa280a220bc"
format_stamp: "Formatted at 2026-08-11 18:57:59 on dist-test-slave-gjw7"
server_key: "b7660244264c27362c2aae1f347698db"
server_key_iv: "24ff8c3a840c3021eeb6d2e057f41c3c"
server_key_version: "encryptionkey@0"
I20260811 18:57:59.225920 12416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:59.236734 12416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:59.239287 12416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:59.239430 12416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:59.239648 12416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:59.239974 12416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:59.240010 12416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:59.240036 12416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:59.240056 12416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:59.246574 12416 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:35947
I20260811 18:57:59.246640 12691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:35947 every 8 connection(s)
I20260811 18:57:59.246999 12416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 18:57:59.250725 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 12416
I20260811 18:57:59.250828 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:57:59.251042 6025 external_mini_cluster.cc:1428] Setting key 9d4c286e0c660d1c060084351e5cb2f1
Aug 11 18:57:59 dist-test-slave-gjw7 krb5kdc[11936](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474679, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:59.257263 12131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:59.247877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:57975 (local address 127.5.226.126:40979)
0811 18:57:59.247946 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:59.247948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:59.248151 (+ 203us) server_negotiation.cc:407] Connection header received
0811 18:57:59.248748 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:59.248750 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:59.248764 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:59.248819 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:59.249927 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:59.250441 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:59.251642 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:59.251900 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:59.251960 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:59.254379 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:59.254381 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:59.254381 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:59.254391 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:59.255772 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:59.256164 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:59.256166 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:59.256166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:59.256245 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:59.256505 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:59.256506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:59.256506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:59.256700 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:59.256795 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:59.257057 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 18:57:59.257159 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 18:57:59.257474 12694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:59.247833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40979 (local address 127.5.226.66:57975)
0811 18:57:59.248024 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:59.248064 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:59.248623 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:59.248925 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:59.248930 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:59.249598 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:59.249823 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:59.249830 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:59.250546 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:59.250546 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:59.251563 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:59.251567 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:59.251980 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:59.251981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:59.252113 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:59.252684 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:59.252694 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:59.254274 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:59.255848 (+ 1574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:59.255855 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:59.255858 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:59.256089 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:59.256318 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:59.256318 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:59.256319 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:59.256418 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:59.256781 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:59.256793 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:59.256923 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 18:57:59.257009 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 18:57:59.257141 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":100,"threads_started":1}
I20260811 18:57:59.258001 12692 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40979
I20260811 18:57:59.258095 12692 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:59.258296 12692 heartbeater.cc:511] Master 127.5.226.126:40979 requested a full tablet report, sending...
I20260811 18:57:59.258711 12041 ts_manager.cc:194] Registered new tserver with Master: 630ee414895943c7918e4fa280a220bc (127.5.226.66:35947)
I20260811 18:57:59.259088 12041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:57975
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 18:57:59.280731 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40979
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:33993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:59.368444 12697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:59.368681 12697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:59.368708 12697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:59.369966 12697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:59.370021 12697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:59.370048 12697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:57:59.371656 12697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:33993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40979
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:59.371930 12697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:59.372174 12697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:59.377442 12710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:59.377465 12708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:59.377435 12713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:59.377636 12697 server_base.cc:1034] running on GCE node
I20260811 18:57:59.377923 12697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:59.378181 12697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:59.379325 12697 hybrid_clock.cc:648] HybridClock initialized: now 1786474679379319 us; error 35 us; skew 500 ppm
Aug 11 18:57:59 dist-test-slave-gjw7 krb5kdc[11936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474679, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:59.382145 12697 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 18:57:59.382644 12697 webserver.cc:460] Webserver started at http://127.5.226.67:45631/ using document root <none> and password file <none>
I20260811 18:57:59.382925 12697 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:59.382992 12697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:59.383136 12697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:59.384259 12697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "4cd3f21595b8439892d44a0769d25b9a"
format_stamp: "Formatted at 2026-08-11 18:57:59 on dist-test-slave-gjw7"
server_key: "cfb88c989249fb24a673eeb1c1c593b0"
server_key_iv: "d942b895676adfbc64cf5643c445e133"
server_key_version: "encryptionkey@0"
I20260811 18:57:59.384622 12697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "4cd3f21595b8439892d44a0769d25b9a"
format_stamp: "Formatted at 2026-08-11 18:57:59 on dist-test-slave-gjw7"
server_key: "cfb88c989249fb24a673eeb1c1c593b0"
server_key_iv: "d942b895676adfbc64cf5643c445e133"
server_key_version: "encryptionkey@0"
I20260811 18:57:59.386339 12697 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 18:57:59.387223 12720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:59.387436 12697 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:59.387547 12697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "4cd3f21595b8439892d44a0769d25b9a"
format_stamp: "Formatted at 2026-08-11 18:57:59 on dist-test-slave-gjw7"
server_key: "cfb88c989249fb24a673eeb1c1c593b0"
server_key_iv: "d942b895676adfbc64cf5643c445e133"
server_key_version: "encryptionkey@0"
I20260811 18:57:59.387624 12697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:59.400138 12697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:59.402607 12697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:59.402761 12697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:59.403014 12697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:59.403357 12697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:59.403395 12697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:59.403426 12697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:59.403451 12697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:59.409488 12697 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:33081
I20260811 18:57:59.409543 12932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:33081 every 8 connection(s)
I20260811 18:57:59.409885 12697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
Aug 11 18:57:59 dist-test-slave-gjw7 krb5kdc[11936](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474679, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:59.417330 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 12697
I20260811 18:57:59.417439 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:57:59.417624 6025 external_mini_cluster.cc:1428] Setting key e592a6b2b863d10e8c59c49bebefb99a
I20260811 18:57:59.419685 12131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:59.410648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:35547 (local address 127.5.226.126:40979)
0811 18:57:59.410712 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:59.410714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:59.410921 (+ 207us) server_negotiation.cc:407] Connection header received
0811 18:57:59.411427 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:59.411428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:59.411439 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:59.411503 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:59.412582 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:59.413195 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:59.414247 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:59.414466 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:59.414523 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:59.416942 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:59.416943 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:59.416944 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:59.416952 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:59.418549 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:59.418949 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:59.418950 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:59.418951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:59.419011 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:59.419197 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:59.419197 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:59.419197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:59.419297 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:59.419364 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:59.419556 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 18:57:59.419620 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 18:57:59.419900 12940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:59.410603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40979 (local address 127.5.226.67:35547)
0811 18:57:59.410780 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:59.410837 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:59.411339 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:59.411573 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:59.411576 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:59.412247 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:59.412474 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:59.412481 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:59.413277 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:59.413277 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:59.414171 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:59.414174 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:59.414566 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:59.414567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:59.414717 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:59.415332 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:59.415342 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:59.416850 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:59.418623 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:59.418631 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:59.418633 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:59.418882 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:59.419062 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:59.419063 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:59.419063 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:59.419157 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:59.419340 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:59.419343 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:59.419463 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 18:57:59.419542 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 18:57:59.419669 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":87,"threads_started":1}
I20260811 18:57:59.420305 12935 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40979
I20260811 18:57:59.420404 12935 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:59.420564 12935 heartbeater.cc:511] Master 127.5.226.126:40979 requested a full tablet report, sending...
I20260811 18:57:59.420918 12041 ts_manager.cc:194] Registered new tserver with Master: 4cd3f21595b8439892d44a0769d25b9a (127.5.226.67:33081)
I20260811 18:57:59.421267 12041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:35547
I20260811 18:57:59.429436 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:57:59 dist-test-slave-gjw7 krb5kdc[11936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474679, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 18:57:59 dist-test-slave-gjw7 krb5kdc[11936](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474679, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:57:59.453645 12131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:59.446289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39984 (local address 127.5.226.126:40979)
0811 18:57:59.446346 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:59.446348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:59.446406 (+ 58us) server_negotiation.cc:407] Connection header received
0811 18:57:59.446481 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:59.446482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:59.446493 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:59.446538 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:59.447069 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:59.447582 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:59.448648 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:59.448863 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:59.448944 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:59.451401 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:59.451403 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:59.451403 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:59.451412 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:59.452590 (+ 1178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:59.452899 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:59.452900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:59.452900 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:59.452948 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:59.453091 (+ 143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:59.453092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:59.453093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:59.453326 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:59.453419 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:59.453505 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 18:57:59.453573 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260811 18:57:59.453886 12041 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:39984
I20260811 18:57:59.454447 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 12167
I20260811 18:57:59.477402 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 12416
I20260811 18:57:59.484154 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 12697
I20260811 18:57:59.492657 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 11969
2026-08-11T18:57:59Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2068 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:59 dist-test-slave-gjw7 krb5kdc[12955](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:59 dist-test-slave-gjw7 krb5kdc[12955](info): set up 2 sockets
Aug 11 18:57:59 dist-test-slave-gjw7 krb5kdc[12955](info): commencing operation
krb5kdc: starting...
W20260811 18:58:00.709690 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:58:00 dist-test-slave-gjw7 krb5kdc[12955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:58:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 18:58:00.833848 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:45049
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:46845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:45049
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:00.915604 12984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:00.915836 12984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:00.915859 12984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:00.917049 12984 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:00.917094 12984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:00.917107 12984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:00.917119 12984 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:00.917130 12984 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:00.918704 12984 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:46845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:45049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:45049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:00.918956 12984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:00.919166 12984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:00.923918 13000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:00.923934 13003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:00.923925 12996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:00.924012 12984 server_base.cc:1034] running on GCE node
I20260811 18:58:00.924368 12984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:00.924660 12984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:00.925809 12984 hybrid_clock.cc:648] HybridClock initialized: now 1786474680925794 us; error 30 us; skew 500 ppm
Aug 11 18:58:00 dist-test-slave-gjw7 krb5kdc[12955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474680, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:00.928236 12984 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 18:58:00.928642 12984 webserver.cc:460] Webserver started at http://127.5.226.126:35037/ using document root <none> and password file <none>
I20260811 18:58:00.928844 12984 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:00.928893 12984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:00.929028 12984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:00.930110 12984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "7281d0322e1245ae9ff6db2bf746a015"
format_stamp: "Formatted at 2026-08-11 18:58:00 on dist-test-slave-gjw7"
server_key: "e1b1fb7afbd69e53a399abcf6170836d"
server_key_iv: "167715ecc43ce556deb0c904a115f021"
server_key_version: "encryptionkey@0"
I20260811 18:58:00.930466 12984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "7281d0322e1245ae9ff6db2bf746a015"
format_stamp: "Formatted at 2026-08-11 18:58:00 on dist-test-slave-gjw7"
server_key: "e1b1fb7afbd69e53a399abcf6170836d"
server_key_iv: "167715ecc43ce556deb0c904a115f021"
server_key_version: "encryptionkey@0"
I20260811 18:58:00.931704 12984 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:58:00.932358 13015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:00.932511 12984 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:00.932616 12984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "7281d0322e1245ae9ff6db2bf746a015"
format_stamp: "Formatted at 2026-08-11 18:58:00 on dist-test-slave-gjw7"
server_key: "e1b1fb7afbd69e53a399abcf6170836d"
server_key_iv: "167715ecc43ce556deb0c904a115f021"
server_key_version: "encryptionkey@0"
I20260811 18:58:00.932679 12984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:00.946817 12984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:00.948565 12984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:00.948700 12984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:00.952529 12984 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:45049
I20260811 18:58:00.952564 13098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:45049 every 8 connection(s)
I20260811 18:58:00.953116 12984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:00.953881 13099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:00.956254 13099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015: Bootstrap starting.
I20260811 18:58:00.956858 13099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:00.957150 13099 log.cc:824] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:00.957870 13099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015: No bootstrap required, opened a new log
I20260811 18:58:00.958925 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 12984
I20260811 18:58:00.959044 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:58:00.959235 6025 external_mini_cluster.cc:1428] Setting key cb9bd150d1fcb47989b381e54b5aa947
I20260811 18:58:00.959824 13099 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7281d0322e1245ae9ff6db2bf746a015" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45049 } }
I20260811 18:58:00.959965 13099 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:00.959987 13099 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7281d0322e1245ae9ff6db2bf746a015, State: Initialized, Role: FOLLOWER
I20260811 18:58:00.960098 13099 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7281d0322e1245ae9ff6db2bf746a015" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45049 } }
I20260811 18:58:00.960172 13099 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:00.960242 13099 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:00.960309 13099 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:00.961011 13099 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7281d0322e1245ae9ff6db2bf746a015" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45049 } }
I20260811 18:58:00.961115 13099 leader_election.cc:302] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7281d0322e1245ae9ff6db2bf746a015; no voters:
I20260811 18:58:00.961267 13099 leader_election.cc:288] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:00.961350 13106 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:00.961465 13106 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [term 1 LEADER]: Becoming Leader. State: Replica: 7281d0322e1245ae9ff6db2bf746a015, State: Running, Role: LEADER
I20260811 18:58:00.961562 13099 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:00.961609 13106 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7281d0322e1245ae9ff6db2bf746a015" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45049 } }
I20260811 18:58:00.962025 13106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7281d0322e1245ae9ff6db2bf746a015. Latest consensus state: current_term: 1 leader_uuid: "7281d0322e1245ae9ff6db2bf746a015" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7281d0322e1245ae9ff6db2bf746a015" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45049 } } }
I20260811 18:58:00.962110 13106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:00.962255 13113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7281d0322e1245ae9ff6db2bf746a015" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7281d0322e1245ae9ff6db2bf746a015" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45049 } } }
I20260811 18:58:00.962330 13113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015 [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:00.962447 13124 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:00.963207 13124 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:00.964737 13124 catalog_manager.cc:1347] Generated new cluster ID: ccfa10cbe86d4b52ad079a0f21462cc7
I20260811 18:58:00.964792 13124 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:58:00 dist-test-slave-gjw7 krb5kdc[12955](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:00.969580 13105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:00.959763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55268 (local address 127.5.226.126:45049)
0811 18:58:00.960515 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:00.960525 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:00.960557 (+ 32us) server_negotiation.cc:407] Connection header received
0811 18:58:00.960673 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:00.960681 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:00.960737 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:00.960886 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:00.961587 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:00.962904 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:00.963694 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:00.964247 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:00.964347 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:00.966610 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:00.966613 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:00.966613 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:00.966624 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:00.968130 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:00.968458 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:00.968461 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:00.968461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:00.968561 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:00.968740 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:00.968741 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:00.968741 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:00.968972 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:00.969122 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:00.969217 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 18:58:00.969386 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":656,"threads_started":1}
I20260811 18:58:00.982158 13124 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:00.982882 13124 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:00.995908 13124 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7281d0322e1245ae9ff6db2bf746a015: Generated new TSK 0
I20260811 18:58:00.996141 13124 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 18:58:01.026475 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:45049
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:46845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:01.113652 13152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:01.113862 13152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:01.113893 13152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:01.115134 13152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:01.115180 13152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:01.115216 13152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:58:01.116802 13152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:46845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:45049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:01.117044 13152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:01.117256 13152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:01.122256 13167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:01.122283 13163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:01.122291 13160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:01.122462 13152 server_base.cc:1034] running on GCE node
I20260811 18:58:01.122660 13152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:01.122861 13152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:01.123987 13152 hybrid_clock.cc:648] HybridClock initialized: now 1786474681123974 us; error 29 us; skew 500 ppm
Aug 11 18:58:01 dist-test-slave-gjw7 krb5kdc[12955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474681, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:01.126497 13152 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 18:58:01.126926 13152 webserver.cc:460] Webserver started at http://127.5.226.65:36881/ using document root <none> and password file <none>
I20260811 18:58:01.127122 13152 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:01.127162 13152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:01.127251 13152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:01.128238 13152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "eb26860caf0f480b91c716908a5a9730"
format_stamp: "Formatted at 2026-08-11 18:58:01 on dist-test-slave-gjw7"
server_key: "34b367f7a5c9e834176793b3434488cb"
server_key_iv: "b0c3235eb901ee7d7d8f88572cfb456b"
server_key_version: "encryptionkey@0"
I20260811 18:58:01.128537 13152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "eb26860caf0f480b91c716908a5a9730"
format_stamp: "Formatted at 2026-08-11 18:58:01 on dist-test-slave-gjw7"
server_key: "34b367f7a5c9e834176793b3434488cb"
server_key_iv: "b0c3235eb901ee7d7d8f88572cfb456b"
server_key_version: "encryptionkey@0"
I20260811 18:58:01.129766 13152 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:58:01.130420 13181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:01.130570 13152 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:01.130657 13152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "eb26860caf0f480b91c716908a5a9730"
format_stamp: "Formatted at 2026-08-11 18:58:01 on dist-test-slave-gjw7"
server_key: "34b367f7a5c9e834176793b3434488cb"
server_key_iv: "b0c3235eb901ee7d7d8f88572cfb456b"
server_key_version: "encryptionkey@0"
I20260811 18:58:01.130719 13152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:01.143007 13152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:01.145115 13152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:01.145252 13152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:01.145494 13152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:01.145794 13152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:01.145828 13152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:01.145859 13152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:01.145875 13152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:01.151571 13152 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:36343
I20260811 18:58:01.151629 13402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:36343 every 8 connection(s)
I20260811 18:58:01.151924 13152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
Aug 11 18:58:01 dist-test-slave-gjw7 krb5kdc[12955](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474681, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:01.160889 13105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:01.152625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:53157 (local address 127.5.226.126:45049)
0811 18:58:01.152684 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:01.152686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:01.152882 (+ 196us) server_negotiation.cc:407] Connection header received
0811 18:58:01.153897 (+ 1015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:01.153899 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:01.153918 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:01.153968 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:01.154622 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.155135 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.156144 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.156347 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.156410 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:01.158444 (+ 2034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:01.158446 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:01.158446 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:01.158456 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:01.159601 (+ 1145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:01.159981 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:01.159982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:01.159983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:01.160037 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:01.160251 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:01.160251 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:01.160252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:01.160371 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:01.160430 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:01.160686 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 18:58:01.160793 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 18:58:01.161037 13407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:01.152599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:45049 (local address 127.5.226.65:53157)
0811 18:58:01.152765 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:01.152803 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:01.153783 (+ 980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:01.154058 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:01.154062 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:01.154323 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:01.154526 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:01.154531 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.155224 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.155225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:01.156055 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:01.156057 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.156428 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.156429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:01.156566 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:01.157012 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:01.157021 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:01.158349 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:01.159677 (+ 1328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:01.159685 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:01.159687 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:01.159912 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:01.160092 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:01.160093 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:01.160093 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:01.160194 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:01.160427 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:01.160435 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:01.160566 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 18:58:01.160655 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 18:58:01.160809 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":81,"threads_started":1}
I20260811 18:58:01.161599 13403 heartbeater.cc:347] Connected to a master server at 127.5.226.126:45049
I20260811 18:58:01.161690 13403 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:01.161873 13403 heartbeater.cc:511] Master 127.5.226.126:45049 requested a full tablet report, sending...
I20260811 18:58:01.162122 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 13152
I20260811 18:58:01.162295 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:58:01.162498 13039 ts_manager.cc:194] Registered new tserver with Master: eb26860caf0f480b91c716908a5a9730 (127.5.226.65:36343)
I20260811 18:58:01.162523 6025 external_mini_cluster.cc:1428] Setting key 1e994ddd8fe3c21e3d4db999696ea2e1
I20260811 18:58:01.163166 13039 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:53157
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 18:58:01.189086 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:45049
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:46845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:01.272259 13410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:01.272467 13410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:01.272490 13410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:01.273624 13410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:01.273658 13410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:01.273681 13410 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:58:01.275177 13410 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:46845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:45049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:01.275373 13410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:01.275548 13410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:01.280433 13423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:01.280435 13427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:01.280462 13421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:01.280571 13410 server_base.cc:1034] running on GCE node
I20260811 18:58:01.280880 13410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:01.281112 13410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:01.282246 13410 hybrid_clock.cc:648] HybridClock initialized: now 1786474681282222 us; error 36 us; skew 500 ppm
Aug 11 18:58:01 dist-test-slave-gjw7 krb5kdc[12955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474681, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:01.284600 13410 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 18:58:01.285019 13410 webserver.cc:460] Webserver started at http://127.5.226.66:33105/ using document root <none> and password file <none>
I20260811 18:58:01.285205 13410 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:01.285246 13410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:01.285388 13410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:01.286373 13410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "d47e2d3a983943748fbe11e631236657"
format_stamp: "Formatted at 2026-08-11 18:58:01 on dist-test-slave-gjw7"
server_key: "9942ee1c59cc15f24c498add3d235ca2"
server_key_iv: "c3cb6e13390d79057ae11f5e9a34fa44"
server_key_version: "encryptionkey@0"
I20260811 18:58:01.286715 13410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "d47e2d3a983943748fbe11e631236657"
format_stamp: "Formatted at 2026-08-11 18:58:01 on dist-test-slave-gjw7"
server_key: "9942ee1c59cc15f24c498add3d235ca2"
server_key_iv: "c3cb6e13390d79057ae11f5e9a34fa44"
server_key_version: "encryptionkey@0"
I20260811 18:58:01.287977 13410 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:58:01.288672 13437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:01.288856 13410 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:01.288947 13410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "d47e2d3a983943748fbe11e631236657"
format_stamp: "Formatted at 2026-08-11 18:58:01 on dist-test-slave-gjw7"
server_key: "9942ee1c59cc15f24c498add3d235ca2"
server_key_iv: "c3cb6e13390d79057ae11f5e9a34fa44"
server_key_version: "encryptionkey@0"
I20260811 18:58:01.289005 13410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:01.307781 13410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:01.309651 13410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:01.309762 13410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:01.309958 13410 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:01.310238 13410 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:01.310271 13410 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:01.310293 13410 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:01.310309 13410 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:01.315776 13410 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:39329
I20260811 18:58:01.315828 13660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:39329 every 8 connection(s)
I20260811 18:58:01.316161 13410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
Aug 11 18:58:01 dist-test-slave-gjw7 krb5kdc[12955](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474681, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:01.325016 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 13410
I20260811 18:58:01.325120 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:58:01.325368 6025 external_mini_cluster.cc:1428] Setting key b368c43673e63fd86663a0f717097688
I20260811 18:58:01.326153 13105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:01.316999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:42165 (local address 127.5.226.126:45049)
0811 18:58:01.317054 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:01.317056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:01.317327 (+ 271us) server_negotiation.cc:407] Connection header received
0811 18:58:01.318503 (+ 1176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:01.318506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:01.318520 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:01.318594 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:01.319441 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.320066 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.321199 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.321461 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.321516 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:01.323540 (+ 2024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:01.323541 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:01.323542 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:01.323549 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:01.324636 (+ 1087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:01.325036 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:01.325037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:01.325037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:01.325107 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:01.325391 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:01.325392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:01.325393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:01.325603 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:01.325673 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:01.325984 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 18:58:01.326082 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:58:01.326365 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:01.316956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:45049 (local address 127.5.226.66:42165)
0811 18:58:01.317130 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:01.317175 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:01.318381 (+ 1206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:01.318680 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:01.318685 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:01.319033 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:01.319324 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:01.319332 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.320160 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.320161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:01.321110 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:01.321113 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.321546 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.321547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:01.321679 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:01.322101 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:01.322109 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:01.323445 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:01.324711 (+ 1266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:01.324720 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:01.324723 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:01.324965 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:01.325183 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:01.325184 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:01.325184 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:01.325331 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:01.325678 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:01.325687 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:01.325843 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 18:58:01.325956 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 18:58:01.326134 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":85,"threads_started":1}
I20260811 18:58:01.326948 13669 heartbeater.cc:347] Connected to a master server at 127.5.226.126:45049
I20260811 18:58:01.327047 13669 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:01.327247 13669 heartbeater.cc:511] Master 127.5.226.126:45049 requested a full tablet report, sending...
I20260811 18:58:01.327618 13039 ts_manager.cc:194] Registered new tserver with Master: d47e2d3a983943748fbe11e631236657 (127.5.226.66:39329)
I20260811 18:58:01.328035 13039 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:42165
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 18:58:01.350029 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:45049
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:46845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:01.431088 13680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:01.431303 13680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:01.431334 13680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:01.432520 13680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:01.432562 13680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:01.432595 13680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:58:01.434180 13680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:46845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:45049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:01.434424 13680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:01.434657 13680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:01.439467 13704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:01.439508 13699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:01.439471 13695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:01.439734 13680 server_base.cc:1034] running on GCE node
I20260811 18:58:01.439949 13680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:01.440172 13680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:01.441355 13680 hybrid_clock.cc:648] HybridClock initialized: now 1786474681441337 us; error 26 us; skew 500 ppm
Aug 11 18:58:01 dist-test-slave-gjw7 krb5kdc[12955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474681, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:01.443723 13680 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 18:58:01.444168 13680 webserver.cc:460] Webserver started at http://127.5.226.67:43359/ using document root <none> and password file <none>
I20260811 18:58:01.444372 13680 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:01.444420 13680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:01.444543 13680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:01.445641 13680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "6ff94d19193647e59d9109d4f72555ee"
format_stamp: "Formatted at 2026-08-11 18:58:01 on dist-test-slave-gjw7"
server_key: "a03c7f11654ce0b2d033e91ad288a72e"
server_key_iv: "5186bce1e089ea7c3968b20efefbab5a"
server_key_version: "encryptionkey@0"
I20260811 18:58:01.445978 13680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "6ff94d19193647e59d9109d4f72555ee"
format_stamp: "Formatted at 2026-08-11 18:58:01 on dist-test-slave-gjw7"
server_key: "a03c7f11654ce0b2d033e91ad288a72e"
server_key_iv: "5186bce1e089ea7c3968b20efefbab5a"
server_key_version: "encryptionkey@0"
I20260811 18:58:01.447190 13680 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:58:01.447852 13717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:01.448011 13680 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:01.448096 13680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "6ff94d19193647e59d9109d4f72555ee"
format_stamp: "Formatted at 2026-08-11 18:58:01 on dist-test-slave-gjw7"
server_key: "a03c7f11654ce0b2d033e91ad288a72e"
server_key_iv: "5186bce1e089ea7c3968b20efefbab5a"
server_key_version: "encryptionkey@0"
I20260811 18:58:01.448156 13680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:01.462430 13680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:01.464668 13680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:01.464813 13680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:01.465056 13680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:01.465392 13680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:01.465435 13680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:01.465461 13680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:01.465480 13680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:01.471731 13680 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:46693
I20260811 18:58:01.471767 13936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:46693 every 8 connection(s)
I20260811 18:58:01.472103 13680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:01.475167 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 13680
I20260811 18:58:01.475247 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:58:01.475409 6025 external_mini_cluster.cc:1428] Setting key 8a16553b4f66ca98fa19c330f8a28d04
Aug 11 18:58:01 dist-test-slave-gjw7 krb5kdc[12955](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474681, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:01.481529 13105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:01.472820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:40937 (local address 127.5.226.126:45049)
0811 18:58:01.472884 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:01.472887 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:01.473148 (+ 261us) server_negotiation.cc:407] Connection header received
0811 18:58:01.474159 (+ 1011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:01.474160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:01.474171 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:01.474221 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:01.474808 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.475349 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.476547 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.476757 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.476813 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:01.478935 (+ 2122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:01.478937 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:01.478937 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:01.478944 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:01.480194 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:01.480553 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:01.480555 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:01.480555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:01.480625 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:01.480919 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:01.480919 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:01.480920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:01.481041 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:01.481100 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:01.481377 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 18:58:01.481460 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 18:58:01.481738 13943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:01.472824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:45049 (local address 127.5.226.67:40937)
0811 18:58:01.473028 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:01.473069 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:01.474070 (+ 1001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:01.474283 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:01.474287 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:01.474542 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:01.474745 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:01.474750 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.475436 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.475437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:01.476470 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:01.476473 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.476877 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.476878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:01.476989 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:01.477531 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:01.477540 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:01.478851 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:01.480255 (+ 1404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:01.480258 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:01.480260 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:01.480467 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:01.480735 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:01.480737 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:01.480737 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:01.480856 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:01.481093 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:01.481096 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:01.481235 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 18:58:01.481351 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 18:58:01.481498 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":89,"threads_started":1}
I20260811 18:58:01.482257 13937 heartbeater.cc:347] Connected to a master server at 127.5.226.126:45049
I20260811 18:58:01.482362 13937 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:01.482551 13937 heartbeater.cc:511] Master 127.5.226.126:45049 requested a full tablet report, sending...
I20260811 18:58:01.482973 13039 ts_manager.cc:194] Registered new tserver with Master: 6ff94d19193647e59d9109d4f72555ee (127.5.226.67:46693)
I20260811 18:58:01.483357 13039 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:40937
I20260811 18:58:01.487442 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:58:01 dist-test-slave-gjw7 krb5kdc[12955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:58:01 dist-test-slave-gjw7 krb5kdc[12955](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.65@KRBTEST.COM
I20260811 18:58:01.511032 13959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:01.503476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49156 (local address 127.5.226.65:36343)
0811 18:58:01.503631 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:01.503636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:01.503647 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:58:01.503677 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:01.503679 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:01.503693 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:01.503782 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:01.504340 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.505093 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.505867 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.506218 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.506284 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:01.508445 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:01.508456 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:01.508456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:01.508464 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:01.509962 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:01.510302 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:01.510305 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:01.510305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:01.510358 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:01.510506 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:01.510506 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:01.510507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:01.510640 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:01.510746 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:01.510883 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 18:58:01.510946 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":74,"threads_started":1}
Aug 11 18:58:01 dist-test-slave-gjw7 krb5kdc[12955](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:01.518657 13105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:01.512409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55280 (local address 127.5.226.126:45049)
0811 18:58:01.512454 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:01.512457 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:01.512466 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:01.512513 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:01.512514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:01.512523 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:01.512564 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:01.512977 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.513521 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.514222 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:01.514414 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:01.514459 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:01.516524 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:01.516525 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:01.516525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:01.516533 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:01.517751 (+ 1218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:01.518037 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:01.518038 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:01.518039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:01.518084 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:01.518208 (+ 124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:01.518208 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:01.518209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:01.518362 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:01.518435 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:01.518532 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 18:58:01.518593 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 18:58:01.518889 13039 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55280
I20260811 18:58:01.519212 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 13152
I20260811 18:58:01.537243 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 13410
I20260811 18:58:01.578791 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 13680
I20260811 18:58:01.592660 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 12984
2026-08-11T18:58:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2103 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:58:01 dist-test-slave-gjw7 krb5kdc[13969](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:58:01 dist-test-slave-gjw7 krb5kdc[13969](info): set up 2 sockets
Aug 11 18:58:01 dist-test-slave-gjw7 krb5kdc[13969](info): commencing operation
krb5kdc: starting...
W20260811 18:58:02.826920 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:58:02 dist-test-slave-gjw7 krb5kdc[13969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:58:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 18:58:02.951464 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:38585
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:36861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:38585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:03.038277 13990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:03.038498 13990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:03.038532 13990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:03.039682 13990 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:03.039724 13990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:03.039743 13990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:03.039758 13990 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:03.039774 13990 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:03.041271 13990 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:36861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:38585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:38585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:03.041554 13990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:03.041754 13990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:03.046370 14002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:03.046375 14000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:03.046494 14007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:03.046391 13990 server_base.cc:1034] running on GCE node
I20260811 18:58:03.046803 13990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:03.047152 13990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:03.048331 13990 hybrid_clock.cc:648] HybridClock initialized: now 1786474683048314 us; error 37 us; skew 500 ppm
Aug 11 18:58:03 dist-test-slave-gjw7 krb5kdc[13969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474683, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:03.051539 13990 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 18:58:03.051923 13990 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:03.051986 13990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:03.052115 13990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:03.053541 13990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "b643b095701647e5a9a6fce669caebb2"
format_stamp: "Formatted at 2026-08-11 18:58:03 on dist-test-slave-gjw7"
server_key: "c1494ac3ead2dcee97c08789ce83c94a"
server_key_iv: "992398880acb96857630ccc12a93b03c"
server_key_version: "encryptionkey@0"
I20260811 18:58:03.053944 13990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "b643b095701647e5a9a6fce669caebb2"
format_stamp: "Formatted at 2026-08-11 18:58:03 on dist-test-slave-gjw7"
server_key: "c1494ac3ead2dcee97c08789ce83c94a"
server_key_iv: "992398880acb96857630ccc12a93b03c"
server_key_version: "encryptionkey@0"
I20260811 18:58:03.055528 13990 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:58:03.056349 14019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:03.056510 13990 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:03.056598 13990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "b643b095701647e5a9a6fce669caebb2"
format_stamp: "Formatted at 2026-08-11 18:58:03 on dist-test-slave-gjw7"
server_key: "c1494ac3ead2dcee97c08789ce83c94a"
server_key_iv: "992398880acb96857630ccc12a93b03c"
server_key_version: "encryptionkey@0"
I20260811 18:58:03.056670 13990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:03.079682 13990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:03.082088 13990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:03.082248 13990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:03.087263 13990 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:38585
I20260811 18:58:03.087312 14118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:38585 every 8 connection(s)
I20260811 18:58:03.087639 13990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:03.088755 14119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:03.091274 14119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2: Bootstrap starting.
I20260811 18:58:03.091864 14119 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:03.092149 14119 log.cc:824] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:03.092839 14119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2: No bootstrap required, opened a new log
I20260811 18:58:03.094761 14119 raft_consensus.cc:348] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b643b095701647e5a9a6fce669caebb2" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38585 } }
I20260811 18:58:03.094967 14119 raft_consensus.cc:374] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:03.095001 14119 raft_consensus.cc:729] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b643b095701647e5a9a6fce669caebb2, State: Initialized, Role: FOLLOWER
I20260811 18:58:03.095175 14119 consensus_queue.cc:260] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b643b095701647e5a9a6fce669caebb2" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38585 } }
I20260811 18:58:03.095239 14119 raft_consensus.cc:388] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:03.095266 14119 raft_consensus.cc:482] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:03.095304 14119 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:03.096314 14119 raft_consensus.cc:504] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b643b095701647e5a9a6fce669caebb2" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38585 } }
I20260811 18:58:03.096418 14119 leader_election.cc:302] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b643b095701647e5a9a6fce669caebb2; no voters:
I20260811 18:58:03.096575 14119 leader_election.cc:288] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:03.096621 14127 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:03.096745 14127 raft_consensus.cc:686] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [term 1 LEADER]: Becoming Leader. State: Replica: b643b095701647e5a9a6fce669caebb2, State: Running, Role: LEADER
I20260811 18:58:03.096830 14127 consensus_queue.cc:237] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b643b095701647e5a9a6fce669caebb2" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38585 } }
I20260811 18:58:03.096860 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 13990
I20260811 18:58:03.096944 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:58:03.097141 6025 external_mini_cluster.cc:1428] Setting key eb6360e9c0f8f6c4bdeaada3e4a9e360
I20260811 18:58:03.097189 14127 sys_catalog.cc:455] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b643b095701647e5a9a6fce669caebb2. Latest consensus state: current_term: 1 leader_uuid: "b643b095701647e5a9a6fce669caebb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b643b095701647e5a9a6fce669caebb2" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38585 } } }
I20260811 18:58:03.097252 14127 sys_catalog.cc:458] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:03.097429 14128 sys_catalog.cc:455] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b643b095701647e5a9a6fce669caebb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b643b095701647e5a9a6fce669caebb2" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38585 } } }
I20260811 18:58:03.097484 14128 sys_catalog.cc:458] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:03.098095 14119 sys_catalog.cc:564] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 18:58:03.099853 14156 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:58:03.099900 14156 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:58:03.103762 14132 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 11 18:58:03 dist-test-slave-gjw7 krb5kdc[13969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:03.105140 14132 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:03.107314 14132 catalog_manager.cc:1347] Generated new cluster ID: 3f0f6988a9dd44819341472d1f339bb3
I20260811 18:58:03.107371 14132 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:03.108966 14137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.097812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55362 (local address 127.5.226.126:38585)
0811 18:58:03.097970 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:03.097980 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:03.098013 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:58:03.098134 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:03.098142 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:03.098200 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:03.098357 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:03.099056 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.100521 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.101644 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.102253 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.102362 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.105157 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:03.105162 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:03.105162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:03.105177 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:03.107520 (+ 2343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:03.107846 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:03.107849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:03.107849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:03.107956 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:03.108131 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:03.108132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:03.108133 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:03.108367 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:03.108516 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:03.108610 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 18:58:03.108757 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":67,"threads_started":1}
I20260811 18:58:03.115013 14132 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:03.115566 14132 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:03.117687 14132 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2: Generated new TSK 0
I20260811 18:58:03.117861 14132 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 18:58:03.154472 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:38585
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:36861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:03.259467 14166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:03.259675 14166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:03.259701 14166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:03.260927 14166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:03.260970 14166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:03.260999 14166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:58:03.262959 14166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:36861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:38585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:03.263200 14166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:03.263413 14166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:58:03.268292 14166 server_base.cc:1034] running on GCE node
W20260811 18:58:03.268208 14178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:03.268232 14181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:03.268253 14179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:03.268639 14166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:03.268882 14166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:03.270023 14166 hybrid_clock.cc:648] HybridClock initialized: now 1786474683270006 us; error 30 us; skew 500 ppm
Aug 11 18:58:03 dist-test-slave-gjw7 krb5kdc[13969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474683, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:03.272516 14166 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 18:58:03.272854 14166 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:03.272905 14166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:03.273029 14166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:03.274127 14166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "3dcf7dd64ba340f9aa83648e36b9f7db"
format_stamp: "Formatted at 2026-08-11 18:58:03 on dist-test-slave-gjw7"
server_key: "d7338dee46978d0678e6568176fb338e"
server_key_iv: "7f0a64e3b9c1217e0361c542dd3ff37b"
server_key_version: "encryptionkey@0"
I20260811 18:58:03.274461 14166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "3dcf7dd64ba340f9aa83648e36b9f7db"
format_stamp: "Formatted at 2026-08-11 18:58:03 on dist-test-slave-gjw7"
server_key: "d7338dee46978d0678e6568176fb338e"
server_key_iv: "7f0a64e3b9c1217e0361c542dd3ff37b"
server_key_version: "encryptionkey@0"
I20260811 18:58:03.275661 14166 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:58:03.276355 14195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:03.276504 14166 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:03.276579 14166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "3dcf7dd64ba340f9aa83648e36b9f7db"
format_stamp: "Formatted at 2026-08-11 18:58:03 on dist-test-slave-gjw7"
server_key: "d7338dee46978d0678e6568176fb338e"
server_key_iv: "7f0a64e3b9c1217e0361c542dd3ff37b"
server_key_version: "encryptionkey@0"
I20260811 18:58:03.276641 14166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:03.292430 14166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:03.294293 14166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:03.294442 14166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:03.294679 14166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:03.295014 14166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:03.295053 14166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:03.295086 14166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:03.295110 14166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:03.301674 14166 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:42963
I20260811 18:58:03.301720 14399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:42963 every 8 connection(s)
I20260811 18:58:03.302012 14166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
Aug 11 18:58:03 dist-test-slave-gjw7 krb5kdc[13969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474683, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:03.311131 14137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.302759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:40487 (local address 127.5.226.126:38585)
0811 18:58:03.302828 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:03.302830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:03.303074 (+ 244us) server_negotiation.cc:407] Connection header received
0811 18:58:03.303553 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:03.303555 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:03.303567 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:03.303629 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:03.304852 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.305444 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.306430 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.306625 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.306687 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.308815 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:03.308817 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:03.308817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:03.308827 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:03.310056 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:03.310408 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:03.310409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:03.310409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:03.310454 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:03.310628 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:03.310628 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:03.310628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:03.310735 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:03.310780 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:03.311000 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 18:58:03.311063 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 18:58:03.311165 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 14166
I20260811 18:58:03.311268 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:58:03.311470 6025 external_mini_cluster.cc:1428] Setting key fd19a7c46cbda72c52cc7cab5cd119a4
I20260811 18:58:03.311476 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.302739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:38585 (local address 127.5.226.65:40487)
0811 18:58:03.302916 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:03.302962 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:03.303464 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:03.303700 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:03.303704 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:03.303978 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:03.304760 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.304767 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.305523 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.305524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.306355 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.306357 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.306700 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.306701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.306810 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.307325 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:03.307334 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:03.308720 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:03.310124 (+ 1404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:03.310130 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:03.310132 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:03.310351 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:03.310497 (+ 146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:03.310497 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:03.310498 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:03.310588 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:03.310777 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:03.310780 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:03.310894 (+ 114us) client_negotiation.cc:769] Sending connection context
0811 18:58:03.310985 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 18:58:03.311154 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":88,"threads_started":1}
I20260811 18:58:03.312012 14405 heartbeater.cc:347] Connected to a master server at 127.5.226.126:38585
I20260811 18:58:03.312122 14405 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:03.312271 14405 heartbeater.cc:511] Master 127.5.226.126:38585 requested a full tablet report, sending...
I20260811 18:58:03.312861 14047 ts_manager.cc:194] Registered new tserver with Master: 3dcf7dd64ba340f9aa83648e36b9f7db (127.5.226.65:42963)
I20260811 18:58:03.313681 14047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:40487
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 18:58:03.338455 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:38585
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:36861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:03.421896 14416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:03.422120 14416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:03.422144 14416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:03.423406 14416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:03.423461 14416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:03.423493 14416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:58:03.425098 14416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:36861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:38585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:03.425377 14416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:03.425604 14416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:03.430465 14426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:03.430585 14416 server_base.cc:1034] running on GCE node
W20260811 18:58:03.430465 14425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:03.430709 14434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:03.430941 14416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:03.431205 14416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:03.432346 14416 hybrid_clock.cc:648] HybridClock initialized: now 1786474683432330 us; error 34 us; skew 500 ppm
Aug 11 18:58:03 dist-test-slave-gjw7 krb5kdc[13969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474683, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:03.434871 14416 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 18:58:03.435204 14416 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:03.435254 14416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:03.435395 14416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:03.436443 14416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "f0b457a8355e49f19abd7125954552dd"
format_stamp: "Formatted at 2026-08-11 18:58:03 on dist-test-slave-gjw7"
server_key: "80c0a23cde95231a32887e57085323fc"
server_key_iv: "57ae2df415fec80b71f10203be0f273a"
server_key_version: "encryptionkey@0"
I20260811 18:58:03.436774 14416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "f0b457a8355e49f19abd7125954552dd"
format_stamp: "Formatted at 2026-08-11 18:58:03 on dist-test-slave-gjw7"
server_key: "80c0a23cde95231a32887e57085323fc"
server_key_iv: "57ae2df415fec80b71f10203be0f273a"
server_key_version: "encryptionkey@0"
I20260811 18:58:03.438068 14416 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:58:03.438809 14445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:03.439005 14416 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:03.439093 14416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "f0b457a8355e49f19abd7125954552dd"
format_stamp: "Formatted at 2026-08-11 18:58:03 on dist-test-slave-gjw7"
server_key: "80c0a23cde95231a32887e57085323fc"
server_key_iv: "57ae2df415fec80b71f10203be0f273a"
server_key_version: "encryptionkey@0"
I20260811 18:58:03.439154 14416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:03.459026 14416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:03.461454 14416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:03.461623 14416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:03.461872 14416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:03.462232 14416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:03.462270 14416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:03.462309 14416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:03.462333 14416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:03.467994 14416 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:43171
I20260811 18:58:03.468057 14682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:43171 every 8 connection(s)
I20260811 18:58:03.468348 14416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 18:58:03.473690 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 14416
I20260811 18:58:03.473794 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:58:03.473999 6025 external_mini_cluster.cc:1428] Setting key aaea8816f4bf093018a2547d227909d6
Aug 11 18:58:03 dist-test-slave-gjw7 krb5kdc[13969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474683, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:03.477628 14137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.469099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:40777 (local address 127.5.226.126:38585)
0811 18:58:03.469171 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:03.469172 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:03.469416 (+ 244us) server_negotiation.cc:407] Connection header received
0811 18:58:03.469957 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:03.469958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:03.469972 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:03.470025 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:03.471021 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.471528 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.472514 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.472706 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.472760 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.475056 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:03.475057 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:03.475057 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:03.475064 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:03.476274 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:03.476708 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:03.476709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:03.476710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:03.476772 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:03.476981 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:03.476982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:03.476982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:03.477108 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:03.477169 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:03.477444 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 18:58:03.477537 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 18:58:03.477708 14686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.469077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:38585 (local address 127.5.226.66:40777)
0811 18:58:03.469259 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:03.469330 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:03.469853 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:03.470109 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:03.470114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:03.470386 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:03.470920 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.470927 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.471613 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.471615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.472429 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.472432 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.472775 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.472776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.472909 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.473415 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:03.473423 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:03.474951 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:03.476364 (+ 1413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:03.476374 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:03.476377 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:03.476640 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:03.476837 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:03.476837 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:03.476837 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:03.476932 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:03.477161 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:03.477165 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:03.477282 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 18:58:03.477401 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 18:58:03.477530 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":90,"threads_started":1}
I20260811 18:58:03.478184 14683 heartbeater.cc:347] Connected to a master server at 127.5.226.126:38585
I20260811 18:58:03.478298 14683 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:03.478454 14683 heartbeater.cc:511] Master 127.5.226.126:38585 requested a full tablet report, sending...
I20260811 18:58:03.478826 14047 ts_manager.cc:194] Registered new tserver with Master: f0b457a8355e49f19abd7125954552dd (127.5.226.66:43171)
I20260811 18:58:03.479367 14047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:40777
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 18:58:03.500514 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:38585
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:36861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:03.583339 14697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:03.583539 14697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:03.583561 14697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:03.584669 14697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:03.584710 14697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:03.584735 14697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:58:03.586201 14697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:36861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:38585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:03.586392 14697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:03.586575 14697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:03.591329 14708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:03.591454 14697 server_base.cc:1034] running on GCE node
W20260811 18:58:03.591352 14715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:03.591531 14709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:03.591768 14697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:03.592007 14697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:03.593150 14697 hybrid_clock.cc:648] HybridClock initialized: now 1786474683593134 us; error 27 us; skew 500 ppm
Aug 11 18:58:03 dist-test-slave-gjw7 krb5kdc[13969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474683, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:03.595543 14697 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 18:58:03.595890 14697 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:03.595954 14697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:03.596086 14697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:03.597115 14697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "8b333628ee6c4d23a9ee7e781d3bb464"
format_stamp: "Formatted at 2026-08-11 18:58:03 on dist-test-slave-gjw7"
server_key: "fb3d9df7d0747bafdd2f6674a0d2d4c3"
server_key_iv: "d4681cdfcb44d2a57cb5ea3365abed21"
server_key_version: "encryptionkey@0"
I20260811 18:58:03.597512 14697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "8b333628ee6c4d23a9ee7e781d3bb464"
format_stamp: "Formatted at 2026-08-11 18:58:03 on dist-test-slave-gjw7"
server_key: "fb3d9df7d0747bafdd2f6674a0d2d4c3"
server_key_iv: "d4681cdfcb44d2a57cb5ea3365abed21"
server_key_version: "encryptionkey@0"
I20260811 18:58:03.598927 14697 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:58:03.599658 14735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:03.599822 14697 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:03.599917 14697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "8b333628ee6c4d23a9ee7e781d3bb464"
format_stamp: "Formatted at 2026-08-11 18:58:03 on dist-test-slave-gjw7"
server_key: "fb3d9df7d0747bafdd2f6674a0d2d4c3"
server_key_iv: "d4681cdfcb44d2a57cb5ea3365abed21"
server_key_version: "encryptionkey@0"
I20260811 18:58:03.599982 14697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:03.618702 14697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:03.620771 14697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:03.620904 14697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:03.621129 14697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:03.621497 14697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:03.621533 14697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:03.621555 14697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:03.621578 14697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:03.627409 14697 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:36283
I20260811 18:58:03.627472 14978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:36283 every 8 connection(s)
I20260811 18:58:03.627722 14697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
Aug 11 18:58:03 dist-test-slave-gjw7 krb5kdc[13969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474683, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:03.636374 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 14697
I20260811 18:58:03.636461 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:58:03.636624 6025 external_mini_cluster.cc:1428] Setting key d117b7ddfa5e5185f7054c5e8af8fee9
I20260811 18:58:03.636991 14137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.628419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:43165 (local address 127.5.226.126:38585)
0811 18:58:03.628468 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:03.628471 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:03.628685 (+ 214us) server_negotiation.cc:407] Connection header received
0811 18:58:03.629160 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:03.629161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:03.629172 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:03.629222 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:03.630177 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.630684 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.631750 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.631954 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.632025 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.634145 (+ 2120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:03.634176 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:03.634176 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:03.634184 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:03.635503 (+ 1319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:03.635925 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:03.635926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:03.635926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:03.635990 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:03.636234 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:03.636236 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:03.636236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:03.636369 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:03.636449 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:03.636811 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 18:58:03.636894 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:58:03.637184 14988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.628409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:38585 (local address 127.5.226.67:43165)
0811 18:58:03.628564 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:03.628602 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:03.629084 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:03.629279 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:03.629282 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:03.629600 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:03.630107 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.630113 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.630792 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.630793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.631650 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.631653 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.632039 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.632040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.632145 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.632617 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:03.632626 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:03.634048 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:03.635586 (+ 1538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:03.635594 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:03.635596 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:03.635833 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:03.636048 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:03.636048 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:03.636049 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:03.636142 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:03.636461 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:03.636471 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:03.636625 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 18:58:03.636750 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 18:58:03.636938 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":77,"threads_started":1}
I20260811 18:58:03.637639 14979 heartbeater.cc:347] Connected to a master server at 127.5.226.126:38585
I20260811 18:58:03.637751 14979 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:03.637883 14979 heartbeater.cc:511] Master 127.5.226.126:38585 requested a full tablet report, sending...
I20260811 18:58:03.638242 14047 ts_manager.cc:194] Registered new tserver with Master: 8b333628ee6c4d23a9ee7e781d3bb464 (127.5.226.67:36283)
I20260811 18:58:03.638578 14047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:43165
I20260811 18:58:03.648504 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:58:03.655826 14137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.649840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55370 (local address 127.5.226.126:38585)
0811 18:58:03.649906 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:03.649908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:03.649955 (+ 47us) server_negotiation.cc:407] Connection header received
0811 18:58:03.650023 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:03.650023 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:03.650032 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:03.650071 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:03.650593 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.651086 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.651922 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.652112 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.652205 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.653483 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:03.653484 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:03.653485 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:03.653492 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:03.654734 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:03.655091 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:03.655093 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:03.655093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:03.655199 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:03.655358 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:03.655359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:03.655359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:03.655516 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:03.655598 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:03.655677 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 18:58:03.655749 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 18:58:03.657519 14047 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:58:03.659065 14047 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:58:03.665647 15012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.661565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:43171 (local address 127.0.0.1:54768)
0811 18:58:03.661761 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:03.661803 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:03.661869 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:03.662112 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:03.662115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:03.662118 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:03.662194 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.662197 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.663256 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.663257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.664321 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.664324 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.665342 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.665343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.665437 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.665455 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 18:58:03.665518 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 18:58:03.665575 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":103,"threads_started":1}
I20260811 18:58:03.665781 15014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.661566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:36283 (local address 127.0.0.1:34278)
0811 18:58:03.661888 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:03.661900 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:03.661964 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:03.662452 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:03.662453 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:03.662455 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:03.662508 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.662510 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.663769 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.663770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.664695 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.664697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.665515 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.665516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.665582 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.665587 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:58:03.665663 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 18:58:03.665704 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":26,"thread_start_us":73,"threads_started":1}
I20260811 18:58:03.665987 15015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.661686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34278 (local address 127.5.226.67:36283)
0811 18:58:03.662296 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:03.662301 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:03.662312 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:58:03.662354 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:03.662356 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:03.662373 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:03.662453 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:03.662566 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.663644 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.664789 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.665428 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.665497 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.665558 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:03.665680 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 18:58:03.665905 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":91,"threads_started":1}
I20260811 18:58:03.666034 15017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.661700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54768 (local address 127.5.226.66:43171)
0811 18:58:03.661914 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:03.661920 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:03.661932 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:58:03.661980 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:03.661982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:03.661999 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:03.662089 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:03.662307 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.663172 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.664402 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.665210 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.665279 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.665381 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:03.665844 (+ 463us) server_negotiation.cc:299] Negotiation successful
0811 18:58:03.665961 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":89,"threads_started":1}
I20260811 18:58:03.666466 15021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.661769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:42963 (local address 127.0.0.1:35386)
0811 18:58:03.662273 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:03.662282 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:03.662329 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:03.662609 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:03.662609 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:03.662611 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:03.662659 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.662661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.663916 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.663917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.665012 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.665016 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.666238 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.666239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.666309 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.666313 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:58:03.666369 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 18:58:03.666406 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":85,"threads_started":1}
I20260811 18:58:03.666743 15022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.662002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35386 (local address 127.5.226.65:42963)
0811 18:58:03.662223 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:03.662228 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:03.662393 (+ 165us) server_negotiation.cc:407] Connection header received
0811 18:58:03.662436 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:03.662439 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:03.662454 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:03.662517 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:03.662745 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.663821 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.665127 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.666144 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.666236 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.666298 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:03.666600 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 18:58:03.666649 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":108,"threads_started":1}
I20260811 18:58:03.666699 14834 tablet_service.cc:1467] Processing CreateTablet for tablet e2f35526dbb14316aec8922eb93929bd (DEFAULT_TABLE table=test-table [id=091e9dad5ccf4007b27047a313cf77e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:03.666816 14543 tablet_service.cc:1467] Processing CreateTablet for tablet e2f35526dbb14316aec8922eb93929bd (DEFAULT_TABLE table=test-table [id=091e9dad5ccf4007b27047a313cf77e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:03.667101 14834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2f35526dbb14316aec8922eb93929bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:03.667160 14543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2f35526dbb14316aec8922eb93929bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:03.667445 14283 tablet_service.cc:1467] Processing CreateTablet for tablet e2f35526dbb14316aec8922eb93929bd (DEFAULT_TABLE table=test-table [id=091e9dad5ccf4007b27047a313cf77e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:03.667752 14283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2f35526dbb14316aec8922eb93929bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:03.669946 15024 tablet_bootstrap.cc:492] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464: Bootstrap starting.
I20260811 18:58:03.670526 15024 tablet_bootstrap.cc:654] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:03.671043 15027 tablet_bootstrap.cc:492] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd: Bootstrap starting.
I20260811 18:58:03.671051 15024 log.cc:824] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:03.671454 15028 tablet_bootstrap.cc:492] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db: Bootstrap starting.
I20260811 18:58:03.671643 15027 tablet_bootstrap.cc:654] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:03.672014 15028 tablet_bootstrap.cc:654] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:03.672120 15027 log.cc:824] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:03.672586 15028 log.cc:824] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:03.672914 15027 tablet_bootstrap.cc:492] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd: No bootstrap required, opened a new log
I20260811 18:58:03.672991 15027 ts_tablet_manager.cc:1397] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:58:03.673382 15024 tablet_bootstrap.cc:492] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464: No bootstrap required, opened a new log
I20260811 18:58:03.673456 15024 ts_tablet_manager.cc:1397] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 18:58:03.675045 15027 raft_consensus.cc:348] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b333628ee6c4d23a9ee7e781d3bb464" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36283 } } peers { permanent_uuid: "f0b457a8355e49f19abd7125954552dd" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 43171 } } peers { permanent_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42963 } }
I20260811 18:58:03.675225 15027 raft_consensus.cc:374] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:03.675283 15027 raft_consensus.cc:729] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0b457a8355e49f19abd7125954552dd, State: Initialized, Role: FOLLOWER
I20260811 18:58:03.675408 15027 consensus_queue.cc:260] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b333628ee6c4d23a9ee7e781d3bb464" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36283 } } peers { permanent_uuid: "f0b457a8355e49f19abd7125954552dd" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 43171 } } peers { permanent_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42963 } }
I20260811 18:58:03.675369 15024 raft_consensus.cc:348] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b333628ee6c4d23a9ee7e781d3bb464" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36283 } } peers { permanent_uuid: "f0b457a8355e49f19abd7125954552dd" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 43171 } } peers { permanent_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42963 } }
I20260811 18:58:03.675508 15024 raft_consensus.cc:374] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:03.675554 15024 raft_consensus.cc:729] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b333628ee6c4d23a9ee7e781d3bb464, State: Initialized, Role: FOLLOWER
I20260811 18:58:03.675664 15024 consensus_queue.cc:260] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b333628ee6c4d23a9ee7e781d3bb464" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36283 } } peers { permanent_uuid: "f0b457a8355e49f19abd7125954552dd" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 43171 } } peers { permanent_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42963 } }
I20260811 18:58:03.675712 15027 ts_tablet_manager.cc:1428] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 18:58:03.675729 14683 heartbeater.cc:503] Master 127.5.226.126:38585 was elected leader, sending a full tablet report...
I20260811 18:58:03.675946 15024 ts_tablet_manager.cc:1428] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:58:03.675988 14979 heartbeater.cc:503] Master 127.5.226.126:38585 was elected leader, sending a full tablet report...
I20260811 18:58:03.676419 15028 tablet_bootstrap.cc:492] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db: No bootstrap required, opened a new log
I20260811 18:58:03.676491 15028 ts_tablet_manager.cc:1397] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 18:58:03.678148 15028 raft_consensus.cc:348] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b333628ee6c4d23a9ee7e781d3bb464" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36283 } } peers { permanent_uuid: "f0b457a8355e49f19abd7125954552dd" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 43171 } } peers { permanent_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42963 } }
I20260811 18:58:03.678284 15028 raft_consensus.cc:374] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:03.678320 15028 raft_consensus.cc:729] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dcf7dd64ba340f9aa83648e36b9f7db, State: Initialized, Role: FOLLOWER
I20260811 18:58:03.678436 15028 consensus_queue.cc:260] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b333628ee6c4d23a9ee7e781d3bb464" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36283 } } peers { permanent_uuid: "f0b457a8355e49f19abd7125954552dd" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 43171 } } peers { permanent_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42963 } }
I20260811 18:58:03.678725 15028 ts_tablet_manager.cc:1428] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:58:03.678771 14405 heartbeater.cc:503] Master 127.5.226.126:38585 was elected leader, sending a full tablet report...
W20260811 18:58:03.718868 14685 tablet.cc:2369] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:58:03.802743 14408 tablet.cc:2369] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:58:03.824136 15044 raft_consensus.cc:482] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:03.824292 15044 raft_consensus.cc:504] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b333628ee6c4d23a9ee7e781d3bb464" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36283 } } peers { permanent_uuid: "f0b457a8355e49f19abd7125954552dd" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 43171 } } peers { permanent_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42963 } }
I20260811 18:58:03.824702 15044 leader_election.cc:288] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b333628ee6c4d23a9ee7e781d3bb464 (127.5.226.67:36283), f0b457a8355e49f19abd7125954552dd (127.5.226.66:43171)
I20260811 18:58:03.827602 15015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.824961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:59903 (local address 127.5.226.67:36283)
0811 18:58:03.825021 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:03.825023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:03.825104 (+ 81us) server_negotiation.cc:407] Connection header received
0811 18:58:03.825186 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:03.825187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:03.825197 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:03.825237 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:03.825436 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.825930 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.826919 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.827297 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.827360 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.827370 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:03.827499 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 18:58:03.827535 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:58:03.827618 15047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.824874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:36283 (local address 127.5.226.65:59903)
0811 18:58:03.825034 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:03.825044 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:03.825113 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:03.825251 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:03.825252 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:03.825253 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:03.825371 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.825373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.826011 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.826012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.826833 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.826835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.827375 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.827376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.827439 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.827443 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:58:03.827488 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 18:58:03.827530 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":16,"thread_start_us":64,"threads_started":1}
I20260811 18:58:03.827725 15017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.824989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:32821 (local address 127.5.226.66:43171)
0811 18:58:03.825053 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:03.825056 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:03.825128 (+ 72us) server_negotiation.cc:407] Connection header received
0811 18:58:03.825216 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:03.825217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:03.825227 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:03.825283 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:03.825463 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.825929 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.826940 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.827380 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.827457 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.827467 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:03.827618 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 18:58:03.827654 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 18:58:03.827741 15046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.824888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:43171 (local address 127.5.226.65:32821)
0811 18:58:03.825050 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:03.825061 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:03.825130 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:03.825316 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:03.825317 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:03.825319 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:03.825395 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.825397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.826017 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.826018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.826845 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:03.826848 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.827461 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.827462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:03.827547 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.827551 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:58:03.827605 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 18:58:03.827646 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":2,"thread_start_us":91,"threads_started":1}
I20260811 18:58:03.828138 14890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2f35526dbb14316aec8922eb93929bd" candidate_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b333628ee6c4d23a9ee7e781d3bb464" is_pre_election: true
I20260811 18:58:03.828197 14588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2f35526dbb14316aec8922eb93929bd" candidate_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0b457a8355e49f19abd7125954552dd" is_pre_election: true
I20260811 18:58:03.828290 14890 raft_consensus.cc:2454] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dcf7dd64ba340f9aa83648e36b9f7db in term 0.
I20260811 18:58:03.828344 14588 raft_consensus.cc:2454] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dcf7dd64ba340f9aa83648e36b9f7db in term 0.
I20260811 18:58:03.828536 14199 leader_election.cc:302] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dcf7dd64ba340f9aa83648e36b9f7db, 8b333628ee6c4d23a9ee7e781d3bb464; no voters:
I20260811 18:58:03.828717 15044 raft_consensus.cc:2781] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:58:03.828761 15044 raft_consensus.cc:482] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:03.828779 15044 raft_consensus.cc:3037] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:03.829550 15044 raft_consensus.cc:504] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b333628ee6c4d23a9ee7e781d3bb464" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36283 } } peers { permanent_uuid: "f0b457a8355e49f19abd7125954552dd" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 43171 } } peers { permanent_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42963 } }
I20260811 18:58:03.829689 15044 leader_election.cc:288] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [CANDIDATE]: Term 1 election: Requested vote from peers 8b333628ee6c4d23a9ee7e781d3bb464 (127.5.226.67:36283), f0b457a8355e49f19abd7125954552dd (127.5.226.66:43171)
I20260811 18:58:03.829836 14588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2f35526dbb14316aec8922eb93929bd" candidate_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0b457a8355e49f19abd7125954552dd"
I20260811 18:58:03.829855 14890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2f35526dbb14316aec8922eb93929bd" candidate_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b333628ee6c4d23a9ee7e781d3bb464"
I20260811 18:58:03.829922 14588 raft_consensus.cc:3037] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:03.829922 14890 raft_consensus.cc:3037] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:03.830826 14588 raft_consensus.cc:2454] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dcf7dd64ba340f9aa83648e36b9f7db in term 1.
I20260811 18:58:03.830826 14890 raft_consensus.cc:2454] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dcf7dd64ba340f9aa83648e36b9f7db in term 1.
I20260811 18:58:03.831000 14196 leader_election.cc:302] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dcf7dd64ba340f9aa83648e36b9f7db, f0b457a8355e49f19abd7125954552dd; no voters:
I20260811 18:58:03.831187 15044 raft_consensus.cc:2781] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:03.831372 15044 raft_consensus.cc:686] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [term 1 LEADER]: Becoming Leader. State: Replica: 3dcf7dd64ba340f9aa83648e36b9f7db, State: Running, Role: LEADER
I20260811 18:58:03.831475 15044 consensus_queue.cc:237] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b333628ee6c4d23a9ee7e781d3bb464" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36283 } } peers { permanent_uuid: "f0b457a8355e49f19abd7125954552dd" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 43171 } } peers { permanent_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42963 } }
I20260811 18:58:03.832413 14046 catalog_manager.cc:5495] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dcf7dd64ba340f9aa83648e36b9f7db (127.5.226.65). New cstate: current_term: 1 leader_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b333628ee6c4d23a9ee7e781d3bb464" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0b457a8355e49f19abd7125954552dd" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 43171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dcf7dd64ba340f9aa83648e36b9f7db" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42963 } health_report { overall_health: HEALTHY } } }
I20260811 18:58:03.847615 15022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.845343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35390 (local address 127.5.226.65:42963)
0811 18:58:03.845391 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:03.845393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:03.845401 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:58:03.845440 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:03.845441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:03.845461 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:03.845526 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:03.845660 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.846128 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.846868 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:03.847072 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:03.847126 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:03.847309 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:03.847412 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:03.847482 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:03.847527 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 18:58:03.847546 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 18:58:03.849375 14890 raft_consensus.cc:1261] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464 [term 1 FOLLOWER]: Refusing update from remote peer 3dcf7dd64ba340f9aa83648e36b9f7db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:03.849400 14588 raft_consensus.cc:1261] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd [term 1 FOLLOWER]: Refusing update from remote peer 3dcf7dd64ba340f9aa83648e36b9f7db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:03.849733 15044 consensus_queue.cc:1035] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0b457a8355e49f19abd7125954552dd" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:03.849874 15048 consensus_queue.cc:1035] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b333628ee6c4d23a9ee7e781d3bb464" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:03.852502 15056 mvcc.cc:205] Tried to move back new op lower bound from 7317400305044185088 to 7317400304974417920. Current Snapshot: MvccSnapshot[applied={T|T < 7317400305044185088 or (T in {7317400305044185088})}]
I20260811 18:58:03.852733 15053 mvcc.cc:205] Tried to move back new op lower bound from 7317400305044185088 to 7317400304974417920. Current Snapshot: MvccSnapshot[applied={T|T < 7317400305044185088 or (T in {7317400305044185088})}]
I20260811 18:58:03.854449 14046 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:03.854533 14046 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:03.855228 14046 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b643b095701647e5a9a6fce669caebb2: Sending DeleteTablet for 3 replicas of tablet e2f35526dbb14316aec8922eb93929bd
I20260811 18:58:03.855569 14283 tablet_service.cc:1514] Processing DeleteTablet for tablet e2f35526dbb14316aec8922eb93929bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:03 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:35386
I20260811 18:58:03.855633 14543 tablet_service.cc:1514] Processing DeleteTablet for tablet e2f35526dbb14316aec8922eb93929bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:03 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:54768
I20260811 18:58:03.855633 14834 tablet_service.cc:1514] Processing DeleteTablet for tablet e2f35526dbb14316aec8922eb93929bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:03 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:34278
I20260811 18:58:03.855885 15071 tablet_replica.cc:330] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db: stopping tablet replica
I20260811 18:58:03.855999 15071 raft_consensus.cc:2229] T e2f35526dbb14316aec8922eb93929bd P 3dcf7dd64ba340f9aa83648e36b9f7db [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:58:03.856143 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 14166
I20260811 18:58:03.856277 15072 tablet_replica.cc:330] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd: stopping tablet replica
I20260811 18:58:03.856360 15072 raft_consensus.cc:2229] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:03.856441 15072 raft_consensus.cc:2258] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:03.856568 15075 tablet_replica.cc:330] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464: stopping tablet replica
I20260811 18:58:03.856719 15075 raft_consensus.cc:2229] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:03.856810 15075 raft_consensus.cc:2258] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:03.861953 15072 ts_tablet_manager.cc:1905] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:03.863487 15075 ts_tablet_manager.cc:1905] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:03.864717 15075 ts_tablet_manager.cc:1918] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:03.864705 15072 ts_tablet_manager.cc:1918] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:03.864782 15075 log.cc:1196] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/e2f35526dbb14316aec8922eb93929bd
I20260811 18:58:03.864782 15072 log.cc:1196] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/e2f35526dbb14316aec8922eb93929bd
I20260811 18:58:03.865057 15075 ts_tablet_manager.cc:1939] T e2f35526dbb14316aec8922eb93929bd P 8b333628ee6c4d23a9ee7e781d3bb464: Deleting consensus metadata
I20260811 18:58:03.865067 15072 ts_tablet_manager.cc:1939] T e2f35526dbb14316aec8922eb93929bd P f0b457a8355e49f19abd7125954552dd: Deleting consensus metadata
I20260811 18:58:03.865566 14021 catalog_manager.cc:4841] TS f0b457a8355e49f19abd7125954552dd (127.5.226.66:43171): tablet e2f35526dbb14316aec8922eb93929bd (table test-table [id=091e9dad5ccf4007b27047a313cf77e2]) successfully deleted
I20260811 18:58:03.865602 14023 catalog_manager.cc:4841] TS 8b333628ee6c4d23a9ee7e781d3bb464 (127.5.226.67:36283): tablet e2f35526dbb14316aec8922eb93929bd (table test-table [id=091e9dad5ccf4007b27047a313cf77e2]) successfully deleted
W20260811 18:58:03.871243 14021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:42963 (error 108)
I20260811 18:58:03.871441 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 14416
I20260811 18:58:03.874405 15021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:03.874284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:42963 (local address 127.0.0.1:35404)
0811 18:58:03.874333 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:03.874370 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:42963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 18:58:03.874503 14021 catalog_manager.cc:4584] TS 3dcf7dd64ba340f9aa83648e36b9f7db (127.5.226.65:42963): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e2f35526dbb14316aec8922eb93929bd: Network error: Client connection negotiation failed: client connection to 127.5.226.65:42963: connect: Connection refused (error 111)
I20260811 18:58:03.883102 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 14697
I20260811 18:58:03.893117 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 13990
2026-08-11T18:58:03Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2299 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T18:58:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:03Z Disabled control of system clock
I20260811 18:58:03.930289 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:35261
--webserver_interface=127.5.226.126
--webserver_port=0
--builtin_ntp_servers=127.5.226.84:37863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:35261
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 18:58:04.010723 15081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:04.010929 15081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:04.010948 15081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:04.012014 15081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:04.012046 15081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:04.012058 15081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:04.012068 15081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:04.012081 15081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:04.013384 15081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:35261
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:35261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:04.013573 15081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:04.013795 15081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:04.018215 15092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:04.018214 15095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:04.018285 15090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:04.018370 15081 server_base.cc:1034] running on GCE node
I20260811 18:58:04.018711 15081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:04.018994 15081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:04.020134 15081 hybrid_clock.cc:648] HybridClock initialized: now 1786474684020117 us; error 28 us; skew 500 ppm
I20260811 18:58:04.021360 15081 webserver.cc:460] Webserver started at http://127.5.226.126:37749/ using document root <none> and password file <none>
I20260811 18:58:04.021572 15081 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:04.021622 15081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:04.021756 15081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:04.022841 15081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "b2967d42307e4e4490b6ecdd9fbdcf12"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "a36737dc4c6ac6158b5ec6bf5603a2c9"
server_key_iv: "8bef724f2634bbf85653f3f7edf5447b"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.023182 15081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "b2967d42307e4e4490b6ecdd9fbdcf12"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "a36737dc4c6ac6158b5ec6bf5603a2c9"
server_key_iv: "8bef724f2634bbf85653f3f7edf5447b"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.024389 15081 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:58:04.025074 15106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:04.025224 15081 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:04.025337 15081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "b2967d42307e4e4490b6ecdd9fbdcf12"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "a36737dc4c6ac6158b5ec6bf5603a2c9"
server_key_iv: "8bef724f2634bbf85653f3f7edf5447b"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.025406 15081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:04.028642 15081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:04.028896 15081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:04.029014 15081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:04.032903 15081 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:35261
I20260811 18:58:04.033063 15218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:35261 every 8 connection(s)
I20260811 18:58:04.033262 15081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:04.033914 15219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:04.034152 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 15081
I20260811 18:58:04.034240 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:58:04.034421 6025 external_mini_cluster.cc:1428] Setting key 894d1df66640ec3fa174ec957c2988e3
I20260811 18:58:04.036876 15229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.034947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44602 (local address 127.5.226.126:35261)
0811 18:58:04.035164 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:04.035173 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:04.035216 (+ 43us) server_negotiation.cc:407] Connection header received
0811 18:58:04.035654 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:04.035664 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:04.035719 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:04.035861 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:04.036444 (+ 583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:04.036448 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:04.036449 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:04.036454 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:04.036500 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:04.036513 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:04.036581 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:04.036640 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 18:58:04.036696 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":91,"threads_started":1}
I20260811 18:58:04.037761 15219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12: Bootstrap starting.
I20260811 18:58:04.038327 15219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:04.038579 15219 log.cc:824] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:04.039215 15219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12: No bootstrap required, opened a new log
I20260811 18:58:04.040529 15219 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2967d42307e4e4490b6ecdd9fbdcf12" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35261 } }
I20260811 18:58:04.040660 15219 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:04.040695 15219 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2967d42307e4e4490b6ecdd9fbdcf12, State: Initialized, Role: FOLLOWER
I20260811 18:58:04.040798 15219 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2967d42307e4e4490b6ecdd9fbdcf12" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35261 } }
I20260811 18:58:04.040867 15219 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:04.040892 15219 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:04.040925 15219 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:04.041406 15219 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2967d42307e4e4490b6ecdd9fbdcf12" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35261 } }
I20260811 18:58:04.041494 15219 leader_election.cc:302] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2967d42307e4e4490b6ecdd9fbdcf12; no voters:
I20260811 18:58:04.041606 15219 leader_election.cc:288] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:04.041863 15219 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:04.041893 15233 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:04.042098 15233 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [term 1 LEADER]: Becoming Leader. State: Replica: b2967d42307e4e4490b6ecdd9fbdcf12, State: Running, Role: LEADER
I20260811 18:58:04.042198 15233 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2967d42307e4e4490b6ecdd9fbdcf12" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35261 } }
I20260811 18:58:04.042536 15236 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2967d42307e4e4490b6ecdd9fbdcf12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2967d42307e4e4490b6ecdd9fbdcf12" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35261 } } }
I20260811 18:58:04.042634 15236 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:04.042778 15236 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2967d42307e4e4490b6ecdd9fbdcf12. Latest consensus state: current_term: 1 leader_uuid: "b2967d42307e4e4490b6ecdd9fbdcf12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2967d42307e4e4490b6ecdd9fbdcf12" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35261 } } }
I20260811 18:58:04.042840 15236 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12 [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:04.042850 15256 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:04.043372 15256 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:04.044927 15256 catalog_manager.cc:1347] Generated new cluster ID: f9e2663e07d04c75b8cd1c5a23bfb781
I20260811 18:58:04.044983 15256 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:04.067682 15256 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:04.067880 15256 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:04.078593 15256 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12: Generated new TSK 0
I20260811 18:58:04.078830 15256 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:58:04.091640 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35261
--builtin_ntp_servers=127.5.226.84:37863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 18:58:04.173939 15278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:04.174142 15278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:04.174173 15278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:04.175321 15278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:04.175359 15278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:04.175392 15278 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:58:04.176715 15278 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15278
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:04.176949 15278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:04.177214 15278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:04.181916 15288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:04.181957 15286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:04.181945 15290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:04.182111 15278 server_base.cc:1034] running on GCE node
I20260811 18:58:04.182333 15278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:04.182555 15278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:04.183696 15278 hybrid_clock.cc:648] HybridClock initialized: now 1786474684183682 us; error 29 us; skew 500 ppm
I20260811 18:58:04.184883 15278 webserver.cc:460] Webserver started at http://127.5.226.65:45019/ using document root <none> and password file <none>
I20260811 18:58:04.185098 15278 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:04.185146 15278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:04.185276 15278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:04.186343 15278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "a9029217df854931bdfa0f288170b9f2"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "a5c735e257eb376504eb6f792e66e8f8"
server_key_iv: "248a9bbb7b84de4113b5ad163882da5f"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.186678 15278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "a9029217df854931bdfa0f288170b9f2"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "a5c735e257eb376504eb6f792e66e8f8"
server_key_iv: "248a9bbb7b84de4113b5ad163882da5f"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.187927 15278 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:58:04.188575 15302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:04.188745 15278 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:04.188830 15278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "a9029217df854931bdfa0f288170b9f2"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "a5c735e257eb376504eb6f792e66e8f8"
server_key_iv: "248a9bbb7b84de4113b5ad163882da5f"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.188896 15278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:04.192117 15278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:04.192351 15278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:04.192463 15278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:04.192648 15278 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:04.192930 15278 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:04.192963 15278 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:04.192988 15278 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:04.193012 15278 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:04.198410 15278 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:39643
I20260811 18:58:04.198470 15553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:39643 every 8 connection(s)
I20260811 18:58:04.198732 15278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 18:58:04.201584 15229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.199391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:42403 (local address 127.5.226.126:35261)
0811 18:58:04.199447 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:04.199449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:04.199649 (+ 200us) server_negotiation.cc:407] Connection header received
0811 18:58:04.200115 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:04.200117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:04.200124 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:04.200183 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:04.201344 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:04.201346 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:04.201346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:04.201351 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:04.201369 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:04.201373 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:04.201422 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:04.201501 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 18:58:04.201516 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 18:58:04.201754 15558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.199360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35261 (local address 127.5.226.65:42403)
0811 18:58:04.199542 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:04.199573 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:04.200018 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:04.200261 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:04.200266 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:04.200276 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:04.201163 (+ 887us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:04.201164 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:04.201192 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:04.201243 (+ 51us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:04.201429 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:04.201435 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:04.201438 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:58:04.201508 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 18:58:04.201569 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":82,"threads_started":1}
I20260811 18:58:04.202220 15554 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35261
I20260811 18:58:04.202311 15554 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:04.202450 15554 heartbeater.cc:511] Master 127.5.226.126:35261 requested a full tablet report, sending...
I20260811 18:58:04.202920 15142 ts_manager.cc:194] Registered new tserver with Master: a9029217df854931bdfa0f288170b9f2 (127.5.226.65:39643)
I20260811 18:58:04.207453 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 15278
I20260811 18:58:04.207537 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:58:04.207703 6025 external_mini_cluster.cc:1428] Setting key 8fed1fc87dc11d4f2ec14553044cc2d2
I20260811 18:58:04.208510 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35261
--builtin_ntp_servers=127.5.226.84:37863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 18:58:04.289923 15561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:04.290124 15561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:04.290145 15561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:04.291345 15561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:04.291385 15561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:04.291419 15561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:58:04.292858 15561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:04.293085 15561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:04.293399 15561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:04.298144 15571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:04.298151 15573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:04.298156 15568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:04.298238 15561 server_base.cc:1034] running on GCE node
I20260811 18:58:04.298568 15561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:04.298794 15561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:04.299942 15561 hybrid_clock.cc:648] HybridClock initialized: now 1786474684299923 us; error 31 us; skew 500 ppm
I20260811 18:58:04.301085 15561 webserver.cc:460] Webserver started at http://127.5.226.66:32919/ using document root <none> and password file <none>
I20260811 18:58:04.301364 15561 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:04.301414 15561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:04.301543 15561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:04.302579 15561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "167c6b73a4c18f25a35594e75c726b9d"
server_key_iv: "f3d42c430e972babe0ad8825ebbb9718"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.302908 15561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "167c6b73a4c18f25a35594e75c726b9d"
server_key_iv: "f3d42c430e972babe0ad8825ebbb9718"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.304083 15561 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:58:04.304723 15585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:04.304893 15561 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:04.305002 15561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "167c6b73a4c18f25a35594e75c726b9d"
server_key_iv: "f3d42c430e972babe0ad8825ebbb9718"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.305063 15561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:04.308199 15561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:04.308405 15561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:04.308492 15561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:04.308641 15561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:04.308889 15561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:04.308918 15561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:04.308936 15561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:04.308952 15561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:04.314263 15561 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:37083
I20260811 18:58:04.314327 15841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:37083 every 8 connection(s)
I20260811 18:58:04.314539 15561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 18:58:04.317130 15229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.315145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:58103 (local address 127.5.226.126:35261)
0811 18:58:04.315191 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:04.315193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:04.315442 (+ 249us) server_negotiation.cc:407] Connection header received
0811 18:58:04.315853 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:04.315855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:04.315860 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:04.315921 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:04.316930 (+ 1009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:04.316932 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:04.316932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:04.316937 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:04.316954 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:04.316958 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:04.317011 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:04.317066 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 18:58:04.317077 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 18:58:04.317323 15849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.315128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35261 (local address 127.5.226.66:58103)
0811 18:58:04.315336 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:04.315367 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:04.315775 (+ 408us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:04.315980 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:04.315982 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:04.315991 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:04.316778 (+ 787us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:04.316779 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:04.316808 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:04.316835 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:04.317016 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:04.317018 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:04.317020 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:58:04.317066 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 18:58:04.317111 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":108,"threads_started":1}
I20260811 18:58:04.317760 15843 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35261
I20260811 18:58:04.317845 15843 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:04.317983 15843 heartbeater.cc:511] Master 127.5.226.126:35261 requested a full tablet report, sending...
I20260811 18:58:04.318315 15142 ts_manager.cc:194] Registered new tserver with Master: 05f5ce0a2aac4e9fb3618d8c9249ea09 (127.5.226.66:37083)
I20260811 18:58:04.323441 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 15561
I20260811 18:58:04.323531 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:58:04.323668 6025 external_mini_cluster.cc:1428] Setting key 3c5641598eeba50f897fbecd765841b7
I20260811 18:58:04.324450 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35261
--builtin_ntp_servers=127.5.226.84:37863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 18:58:04.406831 15850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:04.407024 15850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:04.407044 15850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:04.408249 15850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:04.408298 15850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:04.408324 15850 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:58:04.409724 15850 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:04.409909 15850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:04.410140 15850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:58:04.414947 15850 server_base.cc:1034] running on GCE node
W20260811 18:58:04.414871 15864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:04.414871 15858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:04.414878 15862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:04.415447 15850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:04.415663 15850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:04.416803 15850 hybrid_clock.cc:648] HybridClock initialized: now 1786474684416788 us; error 27 us; skew 500 ppm
I20260811 18:58:04.418051 15850 webserver.cc:460] Webserver started at http://127.5.226.67:41623/ using document root <none> and password file <none>
I20260811 18:58:04.418267 15850 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:04.418318 15850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:04.418447 15850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:04.419509 15850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "5137886ea4634a738066044eeba15a93"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "a3b88003ee2cc5b539a5b17d0e5e251f"
server_key_iv: "2b004ef58c838d97700489b4727f9116"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.419880 15850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "5137886ea4634a738066044eeba15a93"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "a3b88003ee2cc5b539a5b17d0e5e251f"
server_key_iv: "2b004ef58c838d97700489b4727f9116"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.421092 15850 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:58:04.421861 15882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:04.422019 15850 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:04.422108 15850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "5137886ea4634a738066044eeba15a93"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "a3b88003ee2cc5b539a5b17d0e5e251f"
server_key_iv: "2b004ef58c838d97700489b4727f9116"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.422176 15850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:04.425562 15850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:04.425818 15850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:04.425936 15850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:04.426129 15850 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:04.426427 15850 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:04.426462 15850 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:04.426488 15850 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:04.426512 15850 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:04.432156 15850 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:37855
I20260811 18:58:04.432210 16128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:37855 every 8 connection(s)
I20260811 18:58:04.432544 15850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:04.435272 15229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.433256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:35793 (local address 127.5.226.126:35261)
0811 18:58:04.433325 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:04.433327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:04.433509 (+ 182us) server_negotiation.cc:407] Connection header received
0811 18:58:04.433984 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:04.433985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:04.433991 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:04.434050 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:04.435085 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:04.435087 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:04.435087 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:04.435092 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:04.435107 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:04.435111 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:04.435151 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:04.435209 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 18:58:04.435220 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:58:04.435454 16134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.433191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35261 (local address 127.5.226.67:35793)
0811 18:58:04.433392 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:04.433432 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:04.433904 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:04.434118 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:04.434121 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:04.434130 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:04.434953 (+ 823us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:04.434954 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:04.434983 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:04.435011 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:04.435152 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:04.435154 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:04.435157 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:58:04.435210 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 18:58:04.435258 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":71,"threads_started":1}
I20260811 18:58:04.436043 16130 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35261
I20260811 18:58:04.436136 16130 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:04.436275 16130 heartbeater.cc:511] Master 127.5.226.126:35261 requested a full tablet report, sending...
I20260811 18:58:04.436619 15142 ts_manager.cc:194] Registered new tserver with Master: 5137886ea4634a738066044eeba15a93 (127.5.226.67:37855)
I20260811 18:58:04.439962 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 15850
I20260811 18:58:04.440053 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:58:04.440212 6025 external_mini_cluster.cc:1428] Setting key 8992aa29c406ef9f138f9b5724740f35
I20260811 18:58:04.440997 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:58:04.443341 15229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.442324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44608 (local address 127.5.226.126:35261)
0811 18:58:04.442357 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:04.442359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:04.442480 (+ 121us) server_negotiation.cc:407] Connection header received
0811 18:58:04.442543 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:04.442544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:04.442549 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:04.442594 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:04.443130 (+ 536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:04.443131 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:04.443132 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:04.443136 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:04.443150 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:04.443154 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:04.443205 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:04.443259 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 18:58:04.443272 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 18:58:04.444694 15142 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44608:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:58:04.446341 15142 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:58:04.449862 16147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.448325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:37083 (local address 127.0.0.1:37360)
0811 18:58:04.448640 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:04.448647 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:04.448677 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:04.448908 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:04.448916 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:04.448922 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:04.449443 (+ 521us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:04.449443 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:04.449461 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:04.449483 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:04.449702 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:04.449708 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:04.449711 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:58:04.449781 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 18:58:04.449794 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":2,"thread_start_us":98,"threads_started":1}
I20260811 18:58:04.450006 16154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.448573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37360 (local address 127.5.226.66:37083)
0811 18:58:04.448749 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:04.448753 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:04.448762 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:04.448795 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:04.448796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:04.448805 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:04.448882 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:04.449553 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:04.449563 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:04.449563 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:04.449568 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:04.449609 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:04.449639 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:04.449702 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:04.449904 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 18:58:04.449921 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":83,"threads_started":1}
I20260811 18:58:04.450116 16144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.448320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:39643 (local address 127.0.0.1:56726)
0811 18:58:04.448473 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:04.448510 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:04.448564 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:04.449371 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:04.449372 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:04.449375 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:04.449767 (+ 392us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:04.449768 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:04.449775 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:04.449786 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:04.450019 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:04.450020 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:04.450020 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 18:58:04.450046 (+ 26us) client_negotiation.cc:240] Negotiation successful
0811 18:58:04.450058 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":52,"threads_started":1}
I20260811 18:58:04.450327 16152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.448506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56726 (local address 127.5.226.65:39643)
0811 18:58:04.448918 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:04.448922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:04.448931 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:04.449259 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:04.449267 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:04.449276 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:04.449364 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:04.449861 (+ 497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:04.449868 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:04.449869 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:04.449872 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:04.449908 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:04.449949 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:04.450208 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:04.450232 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 18:58:04.450247 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":78,"threads_started":1}
I20260811 18:58:04.450409 16145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.448325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:37855 (local address 127.0.0.1:50420)
0811 18:58:04.448474 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:04.448510 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:04.448564 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:04.449034 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:04.449035 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:04.449039 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:04.449895 (+ 856us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:04.449896 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:04.449904 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:04.449918 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:04.450283 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:04.450284 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:04.450285 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 18:58:04.450336 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 18:58:04.450348 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":101,"threads_started":1}
I20260811 18:58:04.450433 16155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.448730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50420 (local address 127.5.226.67:37855)
0811 18:58:04.448890 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:04.448894 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:04.448903 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:04.448924 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:04.448926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:04.448934 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:04.449796 (+ 862us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:04.450171 (+ 375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:04.450174 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:04.450175 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:04.450178 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:04.450204 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:04.450216 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:04.450293 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:04.450343 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 18:58:04.450357 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":69,"threads_started":1}
I20260811 18:58:04.451056 15700 tablet_service.cc:1467] Processing CreateTablet for tablet d293d0a0ab254c86b0185d51f6784237 (DEFAULT_TABLE table=test-table [id=8ebfb052baa442e6b26de9bd311a2b6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:04.451041 15420 tablet_service.cc:1467] Processing CreateTablet for tablet d293d0a0ab254c86b0185d51f6784237 (DEFAULT_TABLE table=test-table [id=8ebfb052baa442e6b26de9bd311a2b6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:04.451108 15981 tablet_service.cc:1467] Processing CreateTablet for tablet d293d0a0ab254c86b0185d51f6784237 (DEFAULT_TABLE table=test-table [id=8ebfb052baa442e6b26de9bd311a2b6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:04.451392 15700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d293d0a0ab254c86b0185d51f6784237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:04.451412 15981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d293d0a0ab254c86b0185d51f6784237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:04.451413 15420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d293d0a0ab254c86b0185d51f6784237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:04.453905 16156 tablet_bootstrap.cc:492] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09: Bootstrap starting.
I20260811 18:58:04.454569 16156 tablet_bootstrap.cc:654] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:04.454581 16157 tablet_bootstrap.cc:492] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2: Bootstrap starting.
I20260811 18:58:04.454977 16156 log.cc:824] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:04.455233 16157 tablet_bootstrap.cc:654] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:04.455503 16157 log.cc:824] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:04.455870 16156 tablet_bootstrap.cc:492] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09: No bootstrap required, opened a new log
I20260811 18:58:04.455853 16161 tablet_bootstrap.cc:492] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93: Bootstrap starting.
I20260811 18:58:04.455952 16156 ts_tablet_manager.cc:1397] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:58:04.456290 16157 tablet_bootstrap.cc:492] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2: No bootstrap required, opened a new log
I20260811 18:58:04.456349 16157 ts_tablet_manager.cc:1397] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:58:04.456473 16161 tablet_bootstrap.cc:654] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:04.456837 16161 log.cc:824] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:04.457624 16161 tablet_bootstrap.cc:492] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93: No bootstrap required, opened a new log
I20260811 18:58:04.457707 16161 ts_tablet_manager.cc:1397] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:58:04.458436 16157 raft_consensus.cc:348] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9029217df854931bdfa0f288170b9f2" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 39643 } } peers { permanent_uuid: "5137886ea4634a738066044eeba15a93" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37855 } } peers { permanent_uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37083 } }
I20260811 18:58:04.458470 16156 raft_consensus.cc:348] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9029217df854931bdfa0f288170b9f2" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 39643 } } peers { permanent_uuid: "5137886ea4634a738066044eeba15a93" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37855 } } peers { permanent_uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37083 } }
I20260811 18:58:04.458621 16156 raft_consensus.cc:374] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:04.458643 16157 raft_consensus.cc:374] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:04.458689 16156 raft_consensus.cc:729] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f5ce0a2aac4e9fb3618d8c9249ea09, State: Initialized, Role: FOLLOWER
I20260811 18:58:04.458724 16157 raft_consensus.cc:729] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9029217df854931bdfa0f288170b9f2, State: Initialized, Role: FOLLOWER
I20260811 18:58:04.458856 16157 consensus_queue.cc:260] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9029217df854931bdfa0f288170b9f2" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 39643 } } peers { permanent_uuid: "5137886ea4634a738066044eeba15a93" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37855 } } peers { permanent_uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37083 } }
I20260811 18:58:04.458863 16156 consensus_queue.cc:260] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9029217df854931bdfa0f288170b9f2" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 39643 } } peers { permanent_uuid: "5137886ea4634a738066044eeba15a93" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37855 } } peers { permanent_uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37083 } }
I20260811 18:58:04.459110 16157 ts_tablet_manager.cc:1428] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:58:04.459132 16156 ts_tablet_manager.cc:1428] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 18:58:04.459164 15843 heartbeater.cc:503] Master 127.5.226.126:35261 was elected leader, sending a full tablet report...
I20260811 18:58:04.459280 15554 heartbeater.cc:503] Master 127.5.226.126:35261 was elected leader, sending a full tablet report...
I20260811 18:58:04.460170 16161 raft_consensus.cc:348] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9029217df854931bdfa0f288170b9f2" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 39643 } } peers { permanent_uuid: "5137886ea4634a738066044eeba15a93" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37855 } } peers { permanent_uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37083 } }
I20260811 18:58:04.460319 16161 raft_consensus.cc:374] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:04.460364 16161 raft_consensus.cc:729] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5137886ea4634a738066044eeba15a93, State: Initialized, Role: FOLLOWER
I20260811 18:58:04.460471 16161 consensus_queue.cc:260] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9029217df854931bdfa0f288170b9f2" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 39643 } } peers { permanent_uuid: "5137886ea4634a738066044eeba15a93" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37855 } } peers { permanent_uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37083 } }
I20260811 18:58:04.460671 16161 ts_tablet_manager.cc:1428] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:58:04.460736 16130 heartbeater.cc:503] Master 127.5.226.126:35261 was elected leader, sending a full tablet report...
I20260811 18:58:04.509382 16168 raft_consensus.cc:482] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:04.509506 16168 raft_consensus.cc:504] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9029217df854931bdfa0f288170b9f2" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 39643 } } peers { permanent_uuid: "5137886ea4634a738066044eeba15a93" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37855 } } peers { permanent_uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37083 } }
I20260811 18:58:04.509830 16168 leader_election.cc:288] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5137886ea4634a738066044eeba15a93 (127.5.226.67:37855), 05f5ce0a2aac4e9fb3618d8c9249ea09 (127.5.226.66:37083)
I20260811 18:58:04.511013 16155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.510056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:44109 (local address 127.5.226.67:37855)
0811 18:58:04.510115 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:04.510117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:04.510126 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:04.510177 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:04.510178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:04.510184 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:04.510233 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:04.510797 (+ 564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:04.510799 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:04.510799 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:04.510803 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:04.510819 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:04.510824 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:04.510884 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:04.510942 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 18:58:04.510957 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 18:58:04.511010 15558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.509999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:37855 (local address 127.5.226.65:44109)
0811 18:58:04.510066 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:04.510075 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:04.510114 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:04.510261 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:04.510262 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:04.510264 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:04.510683 (+ 419us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:04.510683 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:04.510693 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:04.510708 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:04.510886 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:04.510887 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:04.510887 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 18:58:04.510926 (+ 39us) client_negotiation.cc:240] Negotiation successful
0811 18:58:04.510942 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 18:58:04.511235 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.510007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:37083 (local address 127.5.226.65:54457)
0811 18:58:04.510187 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:04.510195 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:04.510246 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:04.510398 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:04.510399 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:04.510402 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:04.510865 (+ 463us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:04.510865 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:04.510872 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:04.510884 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:04.511060 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:04.511060 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:04.511061 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 18:58:04.511143 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 18:58:04.511158 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":14,"thread_start_us":112,"threads_started":1}
I20260811 18:58:04.511233 16154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.510085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:54457 (local address 127.5.226.66:37083)
0811 18:58:04.510127 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:04.510129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:04.510254 (+ 125us) server_negotiation.cc:407] Connection header received
0811 18:58:04.510319 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:04.510320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:04.510326 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:04.510371 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:04.510970 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:04.510972 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:04.510972 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:04.510977 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:04.510995 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:04.511001 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:04.511055 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:04.511155 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 18:58:04.511171 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:58:04.511390 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d293d0a0ab254c86b0185d51f6784237" candidate_uuid: "a9029217df854931bdfa0f288170b9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5137886ea4634a738066044eeba15a93" is_pre_election: true
I20260811 18:58:04.511564 16025 raft_consensus.cc:2454] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9029217df854931bdfa0f288170b9f2 in term 0.
I20260811 18:58:04.511655 15740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d293d0a0ab254c86b0185d51f6784237" candidate_uuid: "a9029217df854931bdfa0f288170b9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09" is_pre_election: true
I20260811 18:58:04.511812 15740 raft_consensus.cc:2454] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9029217df854931bdfa0f288170b9f2 in term 0.
I20260811 18:58:04.511816 15308 leader_election.cc:302] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5137886ea4634a738066044eeba15a93, a9029217df854931bdfa0f288170b9f2; no voters:
I20260811 18:58:04.511933 16168 raft_consensus.cc:2781] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:58:04.512010 16168 raft_consensus.cc:482] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:04.512035 16168 raft_consensus.cc:3037] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:04.512737 16168 raft_consensus.cc:504] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9029217df854931bdfa0f288170b9f2" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 39643 } } peers { permanent_uuid: "5137886ea4634a738066044eeba15a93" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37855 } } peers { permanent_uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37083 } }
I20260811 18:58:04.512856 16168 leader_election.cc:288] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 5137886ea4634a738066044eeba15a93 (127.5.226.67:37855), 05f5ce0a2aac4e9fb3618d8c9249ea09 (127.5.226.66:37083)
I20260811 18:58:04.512977 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d293d0a0ab254c86b0185d51f6784237" candidate_uuid: "a9029217df854931bdfa0f288170b9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5137886ea4634a738066044eeba15a93"
I20260811 18:58:04.512991 15740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d293d0a0ab254c86b0185d51f6784237" candidate_uuid: "a9029217df854931bdfa0f288170b9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09"
I20260811 18:58:04.513053 15740 raft_consensus.cc:3037] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:04.513054 16025 raft_consensus.cc:3037] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:04.513805 15740 raft_consensus.cc:2454] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9029217df854931bdfa0f288170b9f2 in term 1.
I20260811 18:58:04.513849 16025 raft_consensus.cc:2454] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9029217df854931bdfa0f288170b9f2 in term 1.
I20260811 18:58:04.514001 15307 leader_election.cc:302] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f5ce0a2aac4e9fb3618d8c9249ea09, a9029217df854931bdfa0f288170b9f2; no voters:
I20260811 18:58:04.514097 16168 raft_consensus.cc:2781] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:04.514252 16168 raft_consensus.cc:686] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [term 1 LEADER]: Becoming Leader. State: Replica: a9029217df854931bdfa0f288170b9f2, State: Running, Role: LEADER
I20260811 18:58:04.514333 16168 consensus_queue.cc:237] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9029217df854931bdfa0f288170b9f2" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 39643 } } peers { permanent_uuid: "5137886ea4634a738066044eeba15a93" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37855 } } peers { permanent_uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37083 } }
I20260811 18:58:04.515125 15141 catalog_manager.cc:5495] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9029217df854931bdfa0f288170b9f2 (127.5.226.65). New cstate: current_term: 1 leader_uuid: "a9029217df854931bdfa0f288170b9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9029217df854931bdfa0f288170b9f2" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 39643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5137886ea4634a738066044eeba15a93" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37083 } health_report { overall_health: UNKNOWN } } }
I20260811 18:58:04.525206 16152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.524151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56736 (local address 127.5.226.65:39643)
0811 18:58:04.524217 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:04.524218 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:04.524229 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:58:04.524291 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:04.524292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:04.524306 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:04.524370 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:04.524969 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:04.524971 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:04.524971 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:04.524976 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:04.524993 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:04.524998 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:04.525059 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:04.525128 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 18:58:04.525142 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 18:58:04.527011 15740 raft_consensus.cc:1261] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09 [term 1 FOLLOWER]: Refusing update from remote peer a9029217df854931bdfa0f288170b9f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:04.527011 16025 raft_consensus.cc:1261] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93 [term 1 FOLLOWER]: Refusing update from remote peer a9029217df854931bdfa0f288170b9f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:04.527379 16178 consensus_queue.cc:1035] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5137886ea4634a738066044eeba15a93" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:04.527523 16168 consensus_queue.cc:1035] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f5ce0a2aac4e9fb3618d8c9249ea09" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:04.530097 16188 mvcc.cc:205] Tried to move back new op lower bound from 7317400307820068864 to 7317400307771252736. Current Snapshot: MvccSnapshot[applied={T|T < 7317400307820068864}]
I20260811 18:58:04.530124 16185 mvcc.cc:205] Tried to move back new op lower bound from 7317400307820068864 to 7317400307771252736. Current Snapshot: MvccSnapshot[applied={T|T < 7317400307820068864}]
I20260811 18:58:04.530627 16184 mvcc.cc:205] Tried to move back new op lower bound from 7317400307820068864 to 7317400307771252736. Current Snapshot: MvccSnapshot[applied={T|T < 7317400307820068864}]
I20260811 18:58:04.532593 15141 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44608:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:04.532688 15141 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44608:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:04.533564 15141 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b2967d42307e4e4490b6ecdd9fbdcf12: Sending DeleteTablet for 3 replicas of tablet d293d0a0ab254c86b0185d51f6784237
I20260811 18:58:04.533885 15420 tablet_service.cc:1514] Processing DeleteTablet for tablet d293d0a0ab254c86b0185d51f6784237 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:04 UTC) from {username='slave'} at 127.0.0.1:56726
I20260811 18:58:04.533955 15700 tablet_service.cc:1514] Processing DeleteTablet for tablet d293d0a0ab254c86b0185d51f6784237 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:04 UTC) from {username='slave'} at 127.0.0.1:37360
I20260811 18:58:04.533954 15981 tablet_service.cc:1514] Processing DeleteTablet for tablet d293d0a0ab254c86b0185d51f6784237 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:04 UTC) from {username='slave'} at 127.0.0.1:50420
I20260811 18:58:04.534188 16216 tablet_replica.cc:330] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2: stopping tablet replica
I20260811 18:58:04.534224 16223 tablet_replica.cc:330] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93: stopping tablet replica
I20260811 18:58:04.534329 16216 raft_consensus.cc:2229] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:58:04.534453 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 15278
I20260811 18:58:04.534476 16216 raft_consensus.cc:2258] T d293d0a0ab254c86b0185d51f6784237 P a9029217df854931bdfa0f288170b9f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:04.551620 16223 raft_consensus.cc:2229] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:04.551812 16223 raft_consensus.cc:2258] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:04.552016 16221 tablet_replica.cc:330] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09: stopping tablet replica
I20260811 18:58:04.552140 16221 raft_consensus.cc:2229] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:04.552251 16221 raft_consensus.cc:2258] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:04.552380 16223 ts_tablet_manager.cc:1905] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:04.552774 16221 ts_tablet_manager.cc:1905] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:04.554026 16223 ts_tablet_manager.cc:1918] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:04.554107 16223 log.cc:1196] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/d293d0a0ab254c86b0185d51f6784237
I20260811 18:58:04.554356 16221 ts_tablet_manager.cc:1918] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:04.554405 16223 ts_tablet_manager.cc:1939] T d293d0a0ab254c86b0185d51f6784237 P 5137886ea4634a738066044eeba15a93: Deleting consensus metadata
I20260811 18:58:04.554443 16221 log.cc:1196] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/d293d0a0ab254c86b0185d51f6784237
I20260811 18:58:04.554739 16221 ts_tablet_manager.cc:1939] T d293d0a0ab254c86b0185d51f6784237 P 05f5ce0a2aac4e9fb3618d8c9249ea09: Deleting consensus metadata
I20260811 18:58:04.554858 15114 catalog_manager.cc:4841] TS 5137886ea4634a738066044eeba15a93 (127.5.226.67:37855): tablet d293d0a0ab254c86b0185d51f6784237 (table test-table [id=8ebfb052baa442e6b26de9bd311a2b6a]) successfully deleted
I20260811 18:58:04.555164 15110 catalog_manager.cc:4841] TS 05f5ce0a2aac4e9fb3618d8c9249ea09 (127.5.226.66:37083): tablet d293d0a0ab254c86b0185d51f6784237 (table test-table [id=8ebfb052baa442e6b26de9bd311a2b6a]) successfully deleted
W20260811 18:58:04.556715 15107 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:39643 (error 108)
I20260811 18:58:04.556931 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 15561
I20260811 18:58:04.557183 16145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.557059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:39643 (local address 127.0.0.1:56742)
0811 18:58:04.557111 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:04.557149 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:39643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 18:58:04.560655 15107 catalog_manager.cc:4584] TS a9029217df854931bdfa0f288170b9f2 (127.5.226.65:39643): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d293d0a0ab254c86b0185d51f6784237: Network error: Client connection negotiation failed: client connection to 127.5.226.65:39643: connect: Connection refused (error 111)
I20260811 18:58:04.565639 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 15850
I20260811 18:58:04.580329 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 15081
2026-08-11T18:58:04Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (683 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 18:58:04.606900 6025 mini_oidc.cc:152] Starting JWKS server
I20260811 18:58:04.608178 6025 webserver.cc:460] Webserver started at https://127.0.0.1:33347/ using document root <none> and password file <none>
I20260811 18:58:04.608273 6025 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 18:58:04.608448 6025 webserver.cc:460] Webserver started at http://127.0.0.1:39881/ using document root <none> and password file <none>
2026-08-11T18:58:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:04Z Disabled control of system clock
I20260811 18:58:04.617009 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:35725
--webserver_interface=127.5.226.126
--webserver_port=0
--builtin_ntp_servers=127.5.226.84:35739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:35725
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33347/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/testchainca.cert with env {}
W20260811 18:58:04.697352 16242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:04.697544 16242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:04.697564 16242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:04.698669 16242 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:04.698706 16242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:04.698717 16242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:04.698729 16242 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:04.698738 16242 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:58:04.698750 16242 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:58:04.698760 16242 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33347/jwks.json
I20260811 18:58:04.700238 16242 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:35739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:35725
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:35725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33347/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:04.700434 16242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:04.700601 16242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:04.705430 16254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:04.705425 16251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:04.706424 16257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:04.707365 16242 server_base.cc:1034] running on GCE node
I20260811 18:58:04.707633 16242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:04.707952 16242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:04.709100 16242 hybrid_clock.cc:648] HybridClock initialized: now 1786474684709077 us; error 34 us; skew 500 ppm
I20260811 18:58:04.710330 16242 webserver.cc:460] Webserver started at http://127.5.226.126:46293/ using document root <none> and password file <none>
I20260811 18:58:04.710572 16242 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:04.710620 16242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:04.710753 16242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:04.711794 16242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "9140609c27bc42728b635b0c4986949f"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "0dd20f8270b0a066fc9b9576d30fb184"
server_key_iv: "44f8be2087692670b14e0a80a916fcc0"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.712138 16242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "9140609c27bc42728b635b0c4986949f"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "0dd20f8270b0a066fc9b9576d30fb184"
server_key_iv: "44f8be2087692670b14e0a80a916fcc0"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.713429 16242 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:58:04.714205 16269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:04.714370 16242 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:04.714464 16242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "9140609c27bc42728b635b0c4986949f"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "0dd20f8270b0a066fc9b9576d30fb184"
server_key_iv: "44f8be2087692670b14e0a80a916fcc0"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.714541 16242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:04.726070 16242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:04.726356 16242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:04.726490 16242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:04.730579 16242 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:35725
I20260811 18:58:04.730649 16380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:35725 every 8 connection(s)
I20260811 18:58:04.730947 16242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:04.731150 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 16242
I20260811 18:58:04.731246 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:58:04.731431 6025 external_mini_cluster.cc:1428] Setting key 27f825a85a9a8a4cd6b1bf5cf9259bae
I20260811 18:58:04.732066 16381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:04.735114 16381 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f: Bootstrap starting.
I20260811 18:58:04.735692 16381 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:04.736025 16381 log.cc:824] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:04.736780 16381 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f: No bootstrap required, opened a new log
I20260811 18:58:04.737496 16390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.731896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58132 (local address 127.5.226.126:35725)
0811 18:58:04.732132 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:04.732141 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:04.732174 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:58:04.732712 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:04.732722 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:04.732802 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:04.732944 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:04.733156 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:04.734488 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:04.735347 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:04.735762 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:04.735877 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:04.736899 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:04.736903 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:04.736903 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:04.737053 (+ 150us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:04.737087 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:04.737097 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:04.737151 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:04.737228 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 18:58:04.737340 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":105,"threads_started":1}
I20260811 18:58:04.738396 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:58:04.738945 16381 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9140609c27bc42728b635b0c4986949f" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35725 } }
I20260811 18:58:04.739127 16381 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:04.739194 16381 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9140609c27bc42728b635b0c4986949f, State: Initialized, Role: FOLLOWER
I20260811 18:58:04.739317 16381 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9140609c27bc42728b635b0c4986949f" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35725 } }
I20260811 18:58:04.739418 16381 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:04.739461 16381 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:04.739503 16381 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:04.740015 16381 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9140609c27bc42728b635b0c4986949f" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35725 } }
I20260811 18:58:04.740108 16381 leader_election.cc:302] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9140609c27bc42728b635b0c4986949f; no voters:
I20260811 18:58:04.740262 16381 leader_election.cc:288] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:04.740307 16396 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:04.740473 16396 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [term 1 LEADER]: Becoming Leader. State: Replica: 9140609c27bc42728b635b0c4986949f, State: Running, Role: LEADER
I20260811 18:58:04.740517 16381 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:04.740561 16396 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9140609c27bc42728b635b0c4986949f" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35725 } }
I20260811 18:58:04.740901 16396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9140609c27bc42728b635b0c4986949f. Latest consensus state: current_term: 1 leader_uuid: "9140609c27bc42728b635b0c4986949f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9140609c27bc42728b635b0c4986949f" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35725 } } }
I20260811 18:58:04.740978 16396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:04.741132 16399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9140609c27bc42728b635b0c4986949f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9140609c27bc42728b635b0c4986949f" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35725 } } }
I20260811 18:58:04.741194 16399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:04.741320 16411 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:04.741779 16411 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:04.743251 16411 catalog_manager.cc:1347] Generated new cluster ID: d5ceea6ee0414cd6a25b1f9122a72c1c
I20260811 18:58:04.743315 16411 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:04.753309 16411 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:04.754000 16411 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:04.761334 16411 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9140609c27bc42728b635b0c4986949f: Generated new TSK 0
I20260811 18:58:04.761502 16411 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 18:58:04.797895 16448 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 18:58:04.798048 16448 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 18:58:04.798271 16390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.774871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58144 (local address 127.5.226.126:35725)
0811 18:58:04.774920 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:04.774922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:04.775032 (+ 110us) server_negotiation.cc:407] Connection header received
0811 18:58:04.775131 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:04.775132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:04.775142 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:04.775198 (+ 56us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:58:04.775337 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:04.775843 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:04.776994 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:04.777192 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:04.777252 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:04.777491 (+ 239us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:58:04.797822 (+ 20331us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33347/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 18:58:04.798171 (+ 349us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58144: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33347/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 18:58:04.798338 16390 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58144: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33347/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 18:58:04.798568 16446 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:04.774786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35725 (local address 127.0.0.1:58144)
0811 18:58:04.774963 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:04.774974 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:04.775044 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:04.775205 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:04.775206 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:04.775208 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:58:04.775280 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:04.775283 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:04.775922 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:04.775923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:04.776907 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:04.776910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:04.777266 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:04.777266 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:04.777354 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:04.777378 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:58:04.797984 (+ 20606us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33347/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 18:58:04.798121 (+ 137us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.226.126:35725: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33347/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.5.226.126:35725: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33347/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 18:58:04.798987 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 16242
2026-08-11T18:58:04Z chronyd exiting
I20260811 18:58:04.848779 6025 test_util.cc:175] -----------------------------------------------
I20260811 18:58:04.848865 6025 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474660766540-6025-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (243 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 18:58:04.849750 6025 mini_oidc.cc:152] Starting JWKS server
I20260811 18:58:04.850435 6025 webserver.cc:460] Webserver started at https://127.0.0.1:39101/ using document root <none> and password file <none>
I20260811 18:58:04.850476 6025 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 18:58:04.850613 6025 webserver.cc:460] Webserver started at http://127.0.0.1:40481/ using document root <none> and password file <none>
2026-08-11T18:58:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:04Z Disabled control of system clock
I20260811 18:58:04.859270 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:37057
--webserver_interface=127.5.226.126
--webserver_port=0
--builtin_ntp_servers=127.5.226.84:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:37057
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39101/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/testchainca.cert with env {}
W20260811 18:58:04.943347 16456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:04.943555 16456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:04.943576 16456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:04.944692 16456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:04.944725 16456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:04.944736 16456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:04.944746 16456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:04.944761 16456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:58:04.944772 16456 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:58:04.944787 16456 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39101/jwks.json
I20260811 18:58:04.946252 16456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:37057
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:37057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39101/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:04.946451 16456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:04.946612 16456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:04.951313 16473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:04.951403 16456 server_base.cc:1034] running on GCE node
W20260811 18:58:04.951315 16466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:04.951315 16469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:04.951810 16456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:04.952116 16456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:04.953284 16456 hybrid_clock.cc:648] HybridClock initialized: now 1786474684953259 us; error 36 us; skew 500 ppm
I20260811 18:58:04.954532 16456 webserver.cc:460] Webserver started at http://127.5.226.126:33425/ using document root <none> and password file <none>
I20260811 18:58:04.954761 16456 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:04.954811 16456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:04.954947 16456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:04.956022 16456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "aaa32ddcee4e4dba8c9970e4655ac9e7"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "0dc6862edde6b66415becac4e82cc6ce"
server_key_iv: "585620fd367c251d623f4fb14883bbc4"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.956362 16456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "aaa32ddcee4e4dba8c9970e4655ac9e7"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "0dc6862edde6b66415becac4e82cc6ce"
server_key_iv: "585620fd367c251d623f4fb14883bbc4"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.957609 16456 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:58:04.958315 16492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:04.958462 16456 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:04.958551 16456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "aaa32ddcee4e4dba8c9970e4655ac9e7"
format_stamp: "Formatted at 2026-08-11 18:58:04 on dist-test-slave-gjw7"
server_key: "0dc6862edde6b66415becac4e82cc6ce"
server_key_iv: "585620fd367c251d623f4fb14883bbc4"
server_key_version: "encryptionkey@0"
I20260811 18:58:04.958612 16456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:04.965533 16456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:04.965862 16456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:04.965994 16456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:04.970041 16456 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:37057
I20260811 18:58:04.970072 16591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:37057 every 8 connection(s)
I20260811 18:58:04.970400 16456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:04.971386 16593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:04.973343 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 16456
I20260811 18:58:04.973467 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:58:04.973676 6025 external_mini_cluster.cc:1428] Setting key 27ecac04f7cc9c4e3f94e0eec206ece4
I20260811 18:58:04.974455 16593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7: Bootstrap starting.
I20260811 18:58:04.975067 16593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:04.975425 16593 log.cc:824] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:04.976162 16593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7: No bootstrap required, opened a new log
I20260811 18:58:04.978590 16593 raft_consensus.cc:348] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa32ddcee4e4dba8c9970e4655ac9e7" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37057 } }
I20260811 18:58:04.978765 16593 raft_consensus.cc:374] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:04.978793 16593 raft_consensus.cc:729] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaa32ddcee4e4dba8c9970e4655ac9e7, State: Initialized, Role: FOLLOWER
I20260811 18:58:04.978924 16593 consensus_queue.cc:260] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa32ddcee4e4dba8c9970e4655ac9e7" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37057 } }
I20260811 18:58:04.979017 16593 raft_consensus.cc:388] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:04.979070 16593 raft_consensus.cc:482] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:04.979123 16593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:04.979461 16596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:04.974234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60414 (local address 127.5.226.126:37057)
0811 18:58:04.974412 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:04.974419 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:04.974446 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:58:04.974898 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:04.974905 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:04.974980 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:04.975097 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:04.975378 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:04.976349 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:04.977474 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:04.977868 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:04.977953 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:04.978659 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:04.978662 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:04.978662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:04.978866 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:04.978904 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:04.978915 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:04.978962 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:04.979120 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 18:58:04.979297 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":61,"threads_started":1}
I20260811 18:58:04.979779 16593 raft_consensus.cc:504] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa32ddcee4e4dba8c9970e4655ac9e7" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37057 } }
I20260811 18:58:04.979888 16593 leader_election.cc:302] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aaa32ddcee4e4dba8c9970e4655ac9e7; no voters:
I20260811 18:58:04.980051 16593 leader_election.cc:288] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:04.980189 16601 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:04.980321 16593 sys_catalog.cc:564] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:04.980379 16601 raft_consensus.cc:686] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [term 1 LEADER]: Becoming Leader. State: Replica: aaa32ddcee4e4dba8c9970e4655ac9e7, State: Running, Role: LEADER
I20260811 18:58:04.980436 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:58:04.980499 16601 consensus_queue.cc:237] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa32ddcee4e4dba8c9970e4655ac9e7" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37057 } }
I20260811 18:58:04.980834 16601 sys_catalog.cc:455] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aaa32ddcee4e4dba8c9970e4655ac9e7. Latest consensus state: current_term: 1 leader_uuid: "aaa32ddcee4e4dba8c9970e4655ac9e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa32ddcee4e4dba8c9970e4655ac9e7" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37057 } } }
I20260811 18:58:04.980912 16601 sys_catalog.cc:458] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:04.981065 16603 sys_catalog.cc:455] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aaa32ddcee4e4dba8c9970e4655ac9e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa32ddcee4e4dba8c9970e4655ac9e7" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37057 } } }
I20260811 18:58:04.981122 16603 sys_catalog.cc:458] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7 [sys.catalog]: This master's current role is: LEADER
W20260811 18:58:04.982314 16630 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:58:04.982436 16630 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:58:04.982503 16616 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:04.982653 16616 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:04.984149 16616 catalog_manager.cc:1347] Generated new cluster ID: 4b4b849bbdeb406fb44b37345768f574
I20260811 18:58:04.984197 16616 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:05.006999 16616 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:05.007562 16616 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:05.014813 16616 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aaa32ddcee4e4dba8c9970e4655ac9e7: Generated new TSK 0
I20260811 18:58:05.014991 16616 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 18:58:05.046489 16644 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 18:58:05.046590 16644 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 18:58:05.046829 16596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:05.026466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60428 (local address 127.5.226.126:37057)
0811 18:58:05.026512 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:05.026514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:05.026647 (+ 133us) server_negotiation.cc:407] Connection header received
0811 18:58:05.026726 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:05.026727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:05.026741 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:05.026805 (+ 64us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:58:05.026928 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.027436 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.028213 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.028425 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.028478 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:05.028645 (+ 167us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:58:05.046600 (+ 17955us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39101/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 18:58:05.046774 (+ 174us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60428: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39101/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 18:58:05.046881 16596 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60428: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39101/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 18:58:05.047016 16643 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:05.026429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:37057 (local address 127.0.0.1:60428)
0811 18:58:05.026587 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:05.026596 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:05.026658 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:05.026808 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:05.026809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:05.026811 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:58:05.026873 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:05.026875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.027526 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.027527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:05.028137 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:05.028139 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.028485 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.028486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:05.028550 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:05.028555 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:58:05.046772 (+ 18217us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39101/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 18:58:05.046904 (+ 132us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.226.126:37057: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39101/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":103,"threads_started":1}
I20260811 18:58:05.047358 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 16456
2026-08-11T18:58:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (259 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 18:58:05.108762 6025 mini_oidc.cc:152] Starting JWKS server
I20260811 18:58:05.109489 6025 webserver.cc:460] Webserver started at https://127.0.0.1:39645/ using document root <none> and password file <none>
I20260811 18:58:05.109535 6025 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 18:58:05.109678 6025 webserver.cc:460] Webserver started at http://127.0.0.1:34209/ using document root <none> and password file <none>
2026-08-11T18:58:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:05Z Disabled control of system clock
I20260811 18:58:05.118150 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:32883
--webserver_interface=127.5.226.126
--webserver_port=0
--builtin_ntp_servers=127.5.226.84:41717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:32883
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39645/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 18:58:05.198848 16654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:05.199059 16654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:05.199091 16654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:05.200232 16654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:05.200278 16654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:05.200299 16654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:05.200317 16654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:05.200336 16654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:58:05.200363 16654 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:58:05.200383 16654 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39645/jwks.json
I20260811 18:58:05.201797 16654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:41717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:32883
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:32883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39645/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:05.202059 16654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:05.202339 16654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:05.206910 16676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:05.206913 16669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:05.207010 16671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:05.207094 16654 server_base.cc:1034] running on GCE node
I20260811 18:58:05.207404 16654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:05.207674 16654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:05.208841 16654 hybrid_clock.cc:648] HybridClock initialized: now 1786474685208816 us; error 36 us; skew 500 ppm
I20260811 18:58:05.210158 16654 webserver.cc:460] Webserver started at http://127.5.226.126:36875/ using document root <none> and password file <none>
I20260811 18:58:05.210435 16654 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:05.210485 16654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:05.210618 16654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:05.211642 16654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "467ddad03fa5436fa77a97066365a5d8"
format_stamp: "Formatted at 2026-08-11 18:58:05 on dist-test-slave-gjw7"
server_key: "54ef05549c33bf9d9da3a51559a8c6bb"
server_key_iv: "e6880963b1c4682ae09c9f70d10fd46b"
server_key_version: "encryptionkey@0"
I20260811 18:58:05.212025 16654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "467ddad03fa5436fa77a97066365a5d8"
format_stamp: "Formatted at 2026-08-11 18:58:05 on dist-test-slave-gjw7"
server_key: "54ef05549c33bf9d9da3a51559a8c6bb"
server_key_iv: "e6880963b1c4682ae09c9f70d10fd46b"
server_key_version: "encryptionkey@0"
I20260811 18:58:05.213277 16654 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:58:05.214027 16685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:05.214216 16654 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:05.214306 16654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "467ddad03fa5436fa77a97066365a5d8"
format_stamp: "Formatted at 2026-08-11 18:58:05 on dist-test-slave-gjw7"
server_key: "54ef05549c33bf9d9da3a51559a8c6bb"
server_key_iv: "e6880963b1c4682ae09c9f70d10fd46b"
server_key_version: "encryptionkey@0"
I20260811 18:58:05.214375 16654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:05.224957 16654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:05.225215 16654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:05.225394 16654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:05.229079 16654 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:32883
I20260811 18:58:05.229110 16780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:32883 every 8 connection(s)
I20260811 18:58:05.229452 16654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:05.230118 16781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:05.232043 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 16654
I20260811 18:58:05.232136 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:58:05.232313 6025 external_mini_cluster.cc:1428] Setting key 7ec52f7eb61995b7b7898f3f7382ec91
I20260811 18:58:05.233068 16781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8: Bootstrap starting.
I20260811 18:58:05.233675 16781 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:05.234002 16781 log.cc:824] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:05.234671 16781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8: No bootstrap required, opened a new log
I20260811 18:58:05.236857 16781 raft_consensus.cc:348] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "467ddad03fa5436fa77a97066365a5d8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 32883 } }
I20260811 18:58:05.237011 16781 raft_consensus.cc:374] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:05.237061 16781 raft_consensus.cc:729] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 467ddad03fa5436fa77a97066365a5d8, State: Initialized, Role: FOLLOWER
I20260811 18:58:05.237190 16781 consensus_queue.cc:260] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "467ddad03fa5436fa77a97066365a5d8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 32883 } }
I20260811 18:58:05.237274 16781 raft_consensus.cc:388] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:05.237329 16781 raft_consensus.cc:482] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:05.237378 16781 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:05.237840 16792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:05.232796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50416 (local address 127.5.226.126:32883)
0811 18:58:05.232975 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:05.232983 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:05.233016 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:58:05.233558 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:05.233565 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:05.233628 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:05.233751 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:05.234030 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.234933 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.236004 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.236420 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.236505 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:05.237140 (+ 635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:05.237144 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:05.237144 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:05.237379 (+ 235us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:05.237426 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:05.237441 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:05.237499 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:05.237584 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 18:58:05.237646 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":62,"threads_started":1}
I20260811 18:58:05.237982 16781 raft_consensus.cc:504] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "467ddad03fa5436fa77a97066365a5d8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 32883 } }
I20260811 18:58:05.238090 16781 leader_election.cc:302] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 467ddad03fa5436fa77a97066365a5d8; no voters:
I20260811 18:58:05.238250 16781 leader_election.cc:288] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:05.238291 16795 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:05.238482 16795 raft_consensus.cc:686] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [term 1 LEADER]: Becoming Leader. State: Replica: 467ddad03fa5436fa77a97066365a5d8, State: Running, Role: LEADER
I20260811 18:58:05.238513 16781 sys_catalog.cc:564] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:05.238725 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:58:05.239850 16795 consensus_queue.cc:237] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "467ddad03fa5436fa77a97066365a5d8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 32883 } }
I20260811 18:58:05.240481 16797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "467ddad03fa5436fa77a97066365a5d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "467ddad03fa5436fa77a97066365a5d8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 32883 } } }
I20260811 18:58:05.240783 16797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:05.240500 16796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 467ddad03fa5436fa77a97066365a5d8. Latest consensus state: current_term: 1 leader_uuid: "467ddad03fa5436fa77a97066365a5d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "467ddad03fa5436fa77a97066365a5d8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 32883 } } }
I20260811 18:58:05.240936 16796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8 [sys.catalog]: This master's current role is: LEADER
W20260811 18:58:05.241225 16816 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:58:05.241283 16816 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:58:05.241354 16819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:05.241513 16819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:05.242847 16819 catalog_manager.cc:1347] Generated new cluster ID: 5f2003607d0e4e0f9b5f3a1a46d563b6
I20260811 18:58:05.242901 16819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:05.254700 16819 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:05.255385 16819 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:05.269893 16819 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 467ddad03fa5436fa77a97066365a5d8: Generated new TSK 0
I20260811 18:58:05.270119 16819 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:58:05.280550 16792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:05.277088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50432 (local address 127.5.226.126:32883)
0811 18:58:05.277150 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:05.277152 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:05.277236 (+ 84us) server_negotiation.cc:407] Connection header received
0811 18:58:05.277323 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:05.277324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:05.277336 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:05.277410 (+ 74us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:58:05.277539 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.278052 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.279154 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.279335 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.279390 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:05.279554 (+ 164us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:58:05.280325 (+ 771us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39645/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 18:58:05.280470 (+ 145us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50432: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39645/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 18:58:05.280614 16792 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50432: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39645/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 18:58:05.280611 16847 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:05.277011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:32883 (local address 127.0.0.1:50432)
0811 18:58:05.277153 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:05.277164 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:05.277242 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:05.277420 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:05.277421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:05.277423 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:58:05.277486 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:05.277488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.278125 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.278126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:05.279086 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:05.279089 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.279397 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.279398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:05.279459 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:05.279471 (+ 12us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:58:05.280426 (+ 955us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39645/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 18:58:05.280515 (+ 89us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.226.126:32883: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39645/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260811 18:58:05.280867 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 16654
E20260811 18:58:05.300520 16848 webserver.cc:533] Webserver: sslize failed:
E20260811 18:58:05.300607 16848 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T18:58:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (221 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T18:58:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:05Z Disabled control of system clock
I20260811 18:58:05.339426 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:39351
--webserver_interface=127.5.226.126
--webserver_port=0
--builtin_ntp_servers=127.5.226.84:38569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:39351
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/testchainca.cert with env {}
W20260811 18:58:05.420271 16855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:05.420465 16855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:05.420486 16855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:05.421664 16855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:05.421705 16855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:05.421715 16855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:05.421727 16855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:05.421751 16855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:58:05.421773 16855 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:58:05.421794 16855 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 18:58:05.423273 16855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:38569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:39351
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:39351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:05.423518 16855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:05.423714 16855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:05.428316 16866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:05.428443 16855 server_base.cc:1034] running on GCE node
W20260811 18:58:05.428325 16863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:05.428557 16873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:05.428841 16855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:05.429124 16855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:05.430270 16855 hybrid_clock.cc:648] HybridClock initialized: now 1786474685430241 us; error 41 us; skew 500 ppm
I20260811 18:58:05.431371 16855 webserver.cc:460] Webserver started at http://127.5.226.126:41549/ using document root <none> and password file <none>
I20260811 18:58:05.431574 16855 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:05.431622 16855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:05.431761 16855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:05.432780 16855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "968f26723d794652b59ada5d11c48d7c"
format_stamp: "Formatted at 2026-08-11 18:58:05 on dist-test-slave-gjw7"
server_key: "ab0270d85df4ad1748714cc672677af7"
server_key_iv: "bbbd2607ab4324f8e43821cf12bb9093"
server_key_version: "encryptionkey@0"
I20260811 18:58:05.433113 16855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "968f26723d794652b59ada5d11c48d7c"
format_stamp: "Formatted at 2026-08-11 18:58:05 on dist-test-slave-gjw7"
server_key: "ab0270d85df4ad1748714cc672677af7"
server_key_iv: "bbbd2607ab4324f8e43821cf12bb9093"
server_key_version: "encryptionkey@0"
I20260811 18:58:05.434419 16855 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:05.435213 16894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:05.435386 16855 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:05.435472 16855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "968f26723d794652b59ada5d11c48d7c"
format_stamp: "Formatted at 2026-08-11 18:58:05 on dist-test-slave-gjw7"
server_key: "ab0270d85df4ad1748714cc672677af7"
server_key_iv: "bbbd2607ab4324f8e43821cf12bb9093"
server_key_version: "encryptionkey@0"
I20260811 18:58:05.435539 16855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:05.444717 16855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:05.444977 16855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:05.445096 16855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:05.448851 16855 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:39351
I20260811 18:58:05.448884 16997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:39351 every 8 connection(s)
I20260811 18:58:05.449182 16855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:05.450110 16998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:05.452347 16998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c: Bootstrap starting.
I20260811 18:58:05.452883 16998 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:05.453156 16998 log.cc:824] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:05.453775 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 16855
I20260811 18:58:05.453807 16998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c: No bootstrap required, opened a new log
I20260811 18:58:05.453881 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:58:05.454043 6025 external_mini_cluster.cc:1428] Setting key 81285af277de873d625b66ec584d50dd
I20260811 18:58:05.455775 16998 raft_consensus.cc:348] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "968f26723d794652b59ada5d11c48d7c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 39351 } }
I20260811 18:58:05.455956 16998 raft_consensus.cc:374] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:05.456032 16998 raft_consensus.cc:729] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 968f26723d794652b59ada5d11c48d7c, State: Initialized, Role: FOLLOWER
I20260811 18:58:05.456164 16998 consensus_queue.cc:260] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "968f26723d794652b59ada5d11c48d7c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 39351 } }
I20260811 18:58:05.456250 16998 raft_consensus.cc:388] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:05.456298 16998 raft_consensus.cc:482] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:05.456346 16998 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:05.457000 16998 raft_consensus.cc:504] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "968f26723d794652b59ada5d11c48d7c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 39351 } }
I20260811 18:58:05.457111 16998 leader_election.cc:302] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 968f26723d794652b59ada5d11c48d7c; no voters:
I20260811 18:58:05.457252 16998 leader_election.cc:288] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:05.457335 17006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:05.457494 17006 raft_consensus.cc:686] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [term 1 LEADER]: Becoming Leader. State: Replica: 968f26723d794652b59ada5d11c48d7c, State: Running, Role: LEADER
I20260811 18:58:05.457528 16998 sys_catalog.cc:564] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:05.457638 17006 consensus_queue.cc:237] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "968f26723d794652b59ada5d11c48d7c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 39351 } }
I20260811 18:58:05.458092 17007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "968f26723d794652b59ada5d11c48d7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "968f26723d794652b59ada5d11c48d7c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 39351 } } }
I20260811 18:58:05.458072 17008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 968f26723d794652b59ada5d11c48d7c. Latest consensus state: current_term: 1 leader_uuid: "968f26723d794652b59ada5d11c48d7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "968f26723d794652b59ada5d11c48d7c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 39351 } } }
I20260811 18:58:05.458259 17007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:05.458357 17008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c [sys.catalog]: This master's current role is: LEADER
W20260811 18:58:05.459575 17033 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:58:05.460337 17033 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:58:05.460431 17020 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:05.460642 17020 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:05.461404 17005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:05.454499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56878 (local address 127.5.226.126:39351)
0811 18:58:05.454719 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:05.454728 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:05.454761 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:58:05.455747 (+ 986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:05.455756 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:05.455843 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:05.456001 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:05.456259 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.457934 (+ 1675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.458913 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.459525 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.459670 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:05.460370 (+ 700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:05.460375 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:05.460375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:05.460613 (+ 238us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:05.460659 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:05.460676 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:05.460750 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:05.460977 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 18:58:05.461058 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":80,"threads_started":1}
I20260811 18:58:05.462436 17020 catalog_manager.cc:1347] Generated new cluster ID: de462c50de4747e19d46d164c59f3e7f
I20260811 18:58:05.462496 17020 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:05.462509 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:58:05.467334 17020 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:05.467883 17020 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:05.477198 17020 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 968f26723d794652b59ada5d11c48d7c: Generated new TSK 0
I20260811 18:58:05.477396 17020 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:58:05.537484 17005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:05.483955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56892 (local address 127.5.226.126:39351)
0811 18:58:05.484009 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:05.484012 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:05.484072 (+ 60us) server_negotiation.cc:407] Connection header received
0811 18:58:05.484172 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:05.484173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:05.484187 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:05.484255 (+ 68us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:58:05.484389 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.484888 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.485730 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.485925 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.485986 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:05.486159 (+ 173us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:58:05.537192 (+ 51033us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 18:58:05.537408 (+ 216us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56892: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 18:58:05.537572 17005 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56892: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 18:58:05.537617 17054 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:05.483858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:39351 (local address 127.0.0.1:56892)
0811 18:58:05.484014 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:05.484025 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:05.484090 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:05.484255 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:05.484256 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:05.484258 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:58:05.484323 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:05.484326 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.484979 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.484980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:05.485632 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:05.485636 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:05.485994 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:05.485995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:05.486057 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:05.486064 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:58:05.537375 (+ 51311us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 18:58:05.537498 (+ 123us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.226.126:39351: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260811 18:58:05.537818 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 16855
2026-08-11T18:58:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (243 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (91 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (90 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:58:05 dist-test-slave-gjw7 krb5kdc[17076](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:58:05 dist-test-slave-gjw7 krb5kdc[17076](info): set up 2 sockets
Aug 11 18:58:05 dist-test-slave-gjw7 krb5kdc[17076](info): commencing operation
krb5kdc: starting...
W20260811 18:58:06.949112 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:58:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 18:58:07.070454 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:46451
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:46451
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:07.152086 17115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:07.152313 17115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:07.152343 17115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:07.153575 17115 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:07.153622 17115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:07.153641 17115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:07.153659 17115 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:07.153673 17115 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:07.155215 17115 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:46451
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:46451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:07.155491 17115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:07.155706 17115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:07.160542 17125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:07.160561 17124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:07.160561 17127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:07.160880 17115 server_base.cc:1034] running on GCE node
I20260811 18:58:07.161134 17115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:07.161454 17115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:07.162624 17115 hybrid_clock.cc:648] HybridClock initialized: now 1786474687162609 us; error 27 us; skew 500 ppm
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:07.165249 17115 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 18:58:07.165680 17115 webserver.cc:460] Webserver started at http://127.5.226.126:34519/ using document root <none> and password file <none>
I20260811 18:58:07.165868 17115 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:07.165922 17115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:07.166015 17115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:07.167032 17115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "b26fbffba0ef4cf3a8c46f9d38734099"
format_stamp: "Formatted at 2026-08-11 18:58:07 on dist-test-slave-gjw7"
server_key: "109ed167645a132482039dcc1267e66d"
server_key_iv: "e978be827b75cc7e47f8e3738050fd6f"
server_key_version: "encryptionkey@0"
I20260811 18:58:07.167323 17115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "b26fbffba0ef4cf3a8c46f9d38734099"
format_stamp: "Formatted at 2026-08-11 18:58:07 on dist-test-slave-gjw7"
server_key: "109ed167645a132482039dcc1267e66d"
server_key_iv: "e978be827b75cc7e47f8e3738050fd6f"
server_key_version: "encryptionkey@0"
I20260811 18:58:07.168524 17115 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 18:58:07.169229 17147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.169391 17115 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.169479 17115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "b26fbffba0ef4cf3a8c46f9d38734099"
format_stamp: "Formatted at 2026-08-11 18:58:07 on dist-test-slave-gjw7"
server_key: "109ed167645a132482039dcc1267e66d"
server_key_iv: "e978be827b75cc7e47f8e3738050fd6f"
server_key_version: "encryptionkey@0"
I20260811 18:58:07.169540 17115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:07.179586 17115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:07.181360 17115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:07.181500 17115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:07.185446 17115 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:46451
I20260811 18:58:07.185487 17240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:46451 every 8 connection(s)
I20260811 18:58:07.185824 17115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:07.186671 17241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:07.188992 17241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099: Bootstrap starting.
I20260811 18:58:07.189610 17241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:07.189898 17241 log.cc:824] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:07.190537 17241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099: No bootstrap required, opened a new log
I20260811 18:58:07.192162 17241 raft_consensus.cc:348] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b26fbffba0ef4cf3a8c46f9d38734099" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46451 } }
I20260811 18:58:07.192312 17241 raft_consensus.cc:374] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:07.192348 17241 raft_consensus.cc:729] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b26fbffba0ef4cf3a8c46f9d38734099, State: Initialized, Role: FOLLOWER
I20260811 18:58:07.192487 17241 consensus_queue.cc:260] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b26fbffba0ef4cf3a8c46f9d38734099" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46451 } }
I20260811 18:58:07.192566 17241 raft_consensus.cc:388] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:07.192595 17241 raft_consensus.cc:482] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:07.192643 17241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:07.193157 17241 raft_consensus.cc:504] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b26fbffba0ef4cf3a8c46f9d38734099" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46451 } }
I20260811 18:58:07.193256 17241 leader_election.cc:302] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b26fbffba0ef4cf3a8c46f9d38734099; no voters:
I20260811 18:58:07.193461 17241 leader_election.cc:288] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:07.193511 17244 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:07.193712 17241 sys_catalog.cc:564] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:07.193948 17244 raft_consensus.cc:686] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [term 1 LEADER]: Becoming Leader. State: Replica: b26fbffba0ef4cf3a8c46f9d38734099, State: Running, Role: LEADER
I20260811 18:58:07.194043 17244 consensus_queue.cc:237] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b26fbffba0ef4cf3a8c46f9d38734099" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46451 } }
I20260811 18:58:07.194401 17245 sys_catalog.cc:455] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b26fbffba0ef4cf3a8c46f9d38734099" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b26fbffba0ef4cf3a8c46f9d38734099" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46451 } } }
I20260811 18:58:07.194422 17248 sys_catalog.cc:455] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b26fbffba0ef4cf3a8c46f9d38734099. Latest consensus state: current_term: 1 leader_uuid: "b26fbffba0ef4cf3a8c46f9d38734099" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b26fbffba0ef4cf3a8c46f9d38734099" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46451 } } }
I20260811 18:58:07.194504 17245 sys_catalog.cc:458] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:07.194510 17248 sys_catalog.cc:458] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099 [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:07.194767 17263 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:07.195363 17263 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:07.195545 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 17115
I20260811 18:58:07.195657 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:58:07.195830 6025 external_mini_cluster.cc:1428] Setting key 3ab4fb4d4e70390ea829b7e6384dcc47
I20260811 18:58:07.197031 17263 catalog_manager.cc:1347] Generated new cluster ID: 325a4784578141b6ba830b83dcafb73a
I20260811 18:58:07.197080 17263 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:07.203816 17263 catalog_manager.cc:1370] Generated new certificate authority record
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:07.204303 17263 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:07.208316 17285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:07.196257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39724 (local address 127.5.226.126:46451)
0811 18:58:07.197704 (+ 1447us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:07.197713 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:07.197750 (+ 37us) server_negotiation.cc:407] Connection header received
0811 18:58:07.197880 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:07.197888 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:07.197942 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:07.198079 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:07.198829 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.200288 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.201317 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.201993 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.202121 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:07.204853 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:07.204857 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:07.204858 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:07.204869 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:07.206776 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.207176 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.207178 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.207179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.207275 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.207450 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.207451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.207451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.207696 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:07.207828 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:07.207948 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 18:58:07.208090 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1400,"thread_start_us":70,"threads_started":1}
I20260811 18:58:07.211648 17263 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b26fbffba0ef4cf3a8c46f9d38734099: Generated new TSK 0
I20260811 18:58:07.211817 17263 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 18:58:07.238139 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46451
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:07.319593 17290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:07.319797 17290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:07.319821 17290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:07.320945 17290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:07.320977 17290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:07.321002 17290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:58:07.322557 17290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:07.322755 17290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:07.322942 17290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:07.327775 17319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:07.327781 17305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:07.327791 17300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:07.327984 17290 server_base.cc:1034] running on GCE node
I20260811 18:58:07.328228 17290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:07.328474 17290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:07.329624 17290 hybrid_clock.cc:648] HybridClock initialized: now 1786474687329609 us; error 29 us; skew 500 ppm
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:07.332140 17290 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 18:58:07.332540 17290 webserver.cc:460] Webserver started at http://127.5.226.65:38383/ using document root <none> and password file <none>
I20260811 18:58:07.332742 17290 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:07.332782 17290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:07.332877 17290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:07.333921 17290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "3c025cf2d9cb4d60b5226df484de356d"
format_stamp: "Formatted at 2026-08-11 18:58:07 on dist-test-slave-gjw7"
server_key: "557fd5ba5b40842637444eadcd358531"
server_key_iv: "8afaf52ea1c5436f915612e5b184dcdb"
server_key_version: "encryptionkey@0"
I20260811 18:58:07.334230 17290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "3c025cf2d9cb4d60b5226df484de356d"
format_stamp: "Formatted at 2026-08-11 18:58:07 on dist-test-slave-gjw7"
server_key: "557fd5ba5b40842637444eadcd358531"
server_key_iv: "8afaf52ea1c5436f915612e5b184dcdb"
server_key_version: "encryptionkey@0"
I20260811 18:58:07.335412 17290 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:58:07.336081 17331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.336227 17290 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:07.336310 17290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "3c025cf2d9cb4d60b5226df484de356d"
format_stamp: "Formatted at 2026-08-11 18:58:07 on dist-test-slave-gjw7"
server_key: "557fd5ba5b40842637444eadcd358531"
server_key_iv: "8afaf52ea1c5436f915612e5b184dcdb"
server_key_version: "encryptionkey@0"
I20260811 18:58:07.336377 17290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:07.358965 17290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:07.360733 17290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:07.360852 17290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:07.361097 17290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:07.361443 17290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:07.361480 17290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.361503 17290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:07.361527 17290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.367312 17290 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:39031
I20260811 18:58:07.367357 17579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:39031 every 8 connection(s)
I20260811 18:58:07.367676 17290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 18:58:07.373163 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 17290
I20260811 18:58:07.373282 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:58:07.373486 6025 external_mini_cluster.cc:1428] Setting key 7f55ff90716aae0c1d6e6487e71faf1b
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:07.378496 17285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:07.368375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:48573 (local address 127.5.226.126:46451)
0811 18:58:07.368428 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:07.368430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:07.368630 (+ 200us) server_negotiation.cc:407] Connection header received
0811 18:58:07.369599 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:07.369601 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:07.369612 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:07.369670 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:07.370279 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.370782 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.371761 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.371965 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.372023 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:07.375793 (+ 3770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:07.375795 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:07.375795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:07.375802 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:07.377118 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.377561 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.377563 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.377563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.377623 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.377849 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.377850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.377850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.377966 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:07.378024 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:07.378300 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 18:58:07.378404 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:58:07.378631 17587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:07.368347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:46451 (local address 127.5.226.65:48573)
0811 18:58:07.368510 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:07.368553 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:07.369491 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:07.369744 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:07.369748 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:07.369998 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:07.370186 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:07.370190 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.370843 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.370844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:07.371690 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:07.371693 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.372032 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.372033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:07.372137 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:07.372612 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:07.372620 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:07.374112 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:07.377199 (+ 3087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:07.377206 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:07.377208 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:07.377479 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:07.377677 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:07.377678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:07.377678 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:07.377784 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:07.378024 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:07.378031 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:07.378168 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 18:58:07.378251 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 18:58:07.378412 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":75,"threads_started":1}
I20260811 18:58:07.379148 17580 heartbeater.cc:347] Connected to a master server at 127.5.226.126:46451
I20260811 18:58:07.379268 17580 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:07.379472 17580 heartbeater.cc:511] Master 127.5.226.126:46451 requested a full tablet report, sending...
I20260811 18:58:07.380007 17183 ts_manager.cc:194] Registered new tserver with Master: 3c025cf2d9cb4d60b5226df484de356d (127.5.226.65:39031)
I20260811 18:58:07.380620 17183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:48573
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 18:58:07.398440 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46451
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:07.481243 17592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:07.481490 17592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:07.481514 17592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:07.482667 17592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:07.482717 17592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:07.482758 17592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:58:07.484251 17592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:07.484488 17592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:07.484696 17592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:07.489506 17604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:07.489691 17592 server_base.cc:1034] running on GCE node
W20260811 18:58:07.489781 17605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:07.489836 17607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:07.490099 17592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:07.490355 17592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:07.491541 17592 hybrid_clock.cc:648] HybridClock initialized: now 1786474687491523 us; error 28 us; skew 500 ppm
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:07.494415 17592 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 18:58:07.494894 17592 webserver.cc:460] Webserver started at http://127.5.226.66:42457/ using document root <none> and password file <none>
I20260811 18:58:07.495105 17592 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:07.495148 17592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:07.495250 17592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:07.496302 17592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "36332a4b0b1c47b09dfb5de0b717d192"
format_stamp: "Formatted at 2026-08-11 18:58:07 on dist-test-slave-gjw7"
server_key: "2783006075f07df2917ef96465c8da38"
server_key_iv: "7d74b2357d4867a2fa62eff7179023d1"
server_key_version: "encryptionkey@0"
I20260811 18:58:07.496598 17592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "36332a4b0b1c47b09dfb5de0b717d192"
format_stamp: "Formatted at 2026-08-11 18:58:07 on dist-test-slave-gjw7"
server_key: "2783006075f07df2917ef96465c8da38"
server_key_iv: "7d74b2357d4867a2fa62eff7179023d1"
server_key_version: "encryptionkey@0"
I20260811 18:58:07.497875 17592 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 18:58:07.498586 17622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.498713 17592 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:07.498795 17592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "36332a4b0b1c47b09dfb5de0b717d192"
format_stamp: "Formatted at 2026-08-11 18:58:07 on dist-test-slave-gjw7"
server_key: "2783006075f07df2917ef96465c8da38"
server_key_iv: "7d74b2357d4867a2fa62eff7179023d1"
server_key_version: "encryptionkey@0"
I20260811 18:58:07.498860 17592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:07.511900 17592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:07.514333 17592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:07.514458 17592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:07.514667 17592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:07.514976 17592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:07.515010 17592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.515039 17592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:07.515056 17592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.520545 17592 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:46769
I20260811 18:58:07.520632 17854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:46769 every 8 connection(s)
I20260811 18:58:07.520898 17592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 18:58:07.523960 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 17592
I20260811 18:58:07.524057 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:58:07.524222 6025 external_mini_cluster.cc:1428] Setting key 0da92a4a5fda57d8bb54d34e4fe2f012
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:07.530441 17285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:07.521638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:56533 (local address 127.5.226.126:46451)
0811 18:58:07.521690 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:07.521693 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:07.521897 (+ 204us) server_negotiation.cc:407] Connection header received
0811 18:58:07.522875 (+ 978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:07.522877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:07.522891 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:07.522943 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:07.523579 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.524102 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.525307 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.525504 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.525563 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:07.527842 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:07.527844 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:07.527844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:07.527852 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:07.529088 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.529519 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.529521 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.529521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.529577 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.529814 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.529815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.529815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.529930 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:07.529988 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:07.530259 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 18:58:07.530352 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:58:07.530601 17865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:07.521564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:46451 (local address 127.5.226.66:56533)
0811 18:58:07.521776 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:07.521814 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:07.522760 (+ 946us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:07.523019 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:07.523023 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:07.523286 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:07.523482 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:07.523487 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.524192 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.524193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:07.525204 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:07.525208 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.525579 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.525580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:07.525725 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:07.526193 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:07.526202 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:07.527752 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:07.529168 (+ 1416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:07.529176 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:07.529179 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:07.529449 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:07.529633 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:07.529633 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:07.529634 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:07.529754 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:07.529989 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:07.529996 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:07.530134 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 18:58:07.530224 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 18:58:07.530383 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":85,"threads_started":1}
I20260811 18:58:07.531096 17857 heartbeater.cc:347] Connected to a master server at 127.5.226.126:46451
I20260811 18:58:07.531191 17857 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:07.531378 17857 heartbeater.cc:511] Master 127.5.226.126:46451 requested a full tablet report, sending...
I20260811 18:58:07.531793 17183 ts_manager.cc:194] Registered new tserver with Master: 36332a4b0b1c47b09dfb5de0b717d192 (127.5.226.66:46769)
I20260811 18:58:07.532297 17183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:56533
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 18:58:07.550213 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46451
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:07.632401 17874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:07.632606 17874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:07.632629 17874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:07.633827 17874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:07.633870 17874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:07.633895 17874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:58:07.635372 17874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17874
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:07.635557 17874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:07.635735 17874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:07.640596 17891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:07.640606 17884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:07.640573 17886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:07.640792 17874 server_base.cc:1034] running on GCE node
I20260811 18:58:07.641058 17874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:07.641305 17874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:07.642452 17874 hybrid_clock.cc:648] HybridClock initialized: now 1786474687642443 us; error 27 us; skew 500 ppm
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:07.644881 17874 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 18:58:07.645395 17874 webserver.cc:460] Webserver started at http://127.5.226.67:39417/ using document root <none> and password file <none>
I20260811 18:58:07.645599 17874 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:07.645648 17874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:07.645772 17874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:07.646826 17874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "c532cbd053b24bd6915acbe8c0b8991e"
format_stamp: "Formatted at 2026-08-11 18:58:07 on dist-test-slave-gjw7"
server_key: "844d27e42ca643f7298ba4d7e4d52422"
server_key_iv: "cfa9ed2016cca776388c676cd16a732a"
server_key_version: "encryptionkey@0"
I20260811 18:58:07.647173 17874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "c532cbd053b24bd6915acbe8c0b8991e"
format_stamp: "Formatted at 2026-08-11 18:58:07 on dist-test-slave-gjw7"
server_key: "844d27e42ca643f7298ba4d7e4d52422"
server_key_iv: "cfa9ed2016cca776388c676cd16a732a"
server_key_version: "encryptionkey@0"
I20260811 18:58:07.648435 17874 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:58:07.649091 17906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.649242 17874 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:07.649350 17874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "c532cbd053b24bd6915acbe8c0b8991e"
format_stamp: "Formatted at 2026-08-11 18:58:07 on dist-test-slave-gjw7"
server_key: "844d27e42ca643f7298ba4d7e4d52422"
server_key_iv: "cfa9ed2016cca776388c676cd16a732a"
server_key_version: "encryptionkey@0"
I20260811 18:58:07.649421 17874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:07.668632 17874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:07.670711 17874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:07.670861 17874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:07.671121 17874 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:07.671456 17874 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:07.671491 17874 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.671520 17874 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:07.671538 17874 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.677212 17874 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:41317
I20260811 18:58:07.677271 18136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:41317 every 8 connection(s)
I20260811 18:58:07.677587 17874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:07.685709 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 17874
I20260811 18:58:07.685798 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:58:07.686007 6025 external_mini_cluster.cc:1428] Setting key ae670dce068c69dd03a18efdceff0e08
I20260811 18:58:07.686913 17285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:07.678336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:46793 (local address 127.5.226.126:46451)
0811 18:58:07.678405 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:07.678408 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:07.678639 (+ 231us) server_negotiation.cc:407] Connection header received
0811 18:58:07.679608 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:07.679610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:07.679621 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:07.679678 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:07.680336 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.680833 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.681885 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.682081 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.682139 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:07.684188 (+ 2049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:07.684189 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:07.684189 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:07.684196 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:07.685486 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.685877 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.685879 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.685880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.685945 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.686210 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.686211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.686211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.686358 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:07.686426 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:07.686734 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 18:58:07.686817 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 18:58:07.687070 18140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:07.678294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:46451 (local address 127.5.226.67:46793)
0811 18:58:07.678499 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:07.678540 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:07.679505 (+ 965us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:07.679782 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:07.679786 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:07.680039 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:07.680258 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:07.680263 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.680914 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.680915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:07.681804 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:07.681807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.682173 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.682174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:07.682299 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:07.682780 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:07.682790 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:07.684109 (+ 1319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:07.685570 (+ 1461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:07.685577 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:07.685579 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:07.685809 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:07.686009 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:07.686010 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:07.686010 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:07.686136 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:07.686465 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:07.686472 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:07.686593 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 18:58:07.686699 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 18:58:07.686844 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":98,"threads_started":1}
I20260811 18:58:07.687538 18137 heartbeater.cc:347] Connected to a master server at 127.5.226.126:46451
I20260811 18:58:07.687625 18137 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:07.687800 18137 heartbeater.cc:511] Master 127.5.226.126:46451 requested a full tablet report, sending...
I20260811 18:58:07.688153 17183 ts_manager.cc:194] Registered new tserver with Master: c532cbd053b24bd6915acbe8c0b8991e (127.5.226.67:41317)
I20260811 18:58:07.688516 17183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:46793
I20260811 18:58:07.697845 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/test-admin.keytab.
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:07.714015 6025 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 18:58:07.715555 18149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:07.714821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33078 (local address 127.5.226.65:39031)
0811 18:58:07.715023 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:07.715028 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:07.715039 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:58:07.715069 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:07.715071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:07.715085 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:07.715150 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:07.715488 (+ 338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33078: BlockingRecv error: recv got EOF from 127.0.0.1:33078 (error 108)
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":109,"threads_started":1}
W20260811 18:58:07.715756 6025 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/krb5cc' of type FILE
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:07.716745 6025 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:07.717628 6025 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.65@KRBTEST.COM
I20260811 18:58:07.727809 18149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:07.718123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33094 (local address 127.5.226.65:39031)
0811 18:58:07.718167 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:07.718169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:07.718234 (+ 65us) server_negotiation.cc:407] Connection header received
0811 18:58:07.718261 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:07.718262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:07.718273 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:07.718316 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:07.718655 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.719389 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.720066 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.720422 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.720475 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:07.725333 (+ 4858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:07.725342 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:07.725343 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:07.725350 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:07.726774 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.727113 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.727117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.727118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.727181 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.727358 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.727358 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.727358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.727495 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:07.727608 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:07.727641 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 18:58:07.727705 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 18:58:07.729576 18149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:07.729045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33110 (local address 127.5.226.65:39031)
0811 18:58:07.729104 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:07.729105 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:07.729134 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:58:07.729182 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:07.729183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:07.729193 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:07.729236 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:07.729536 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33110: BlockingRecv error: recv got EOF from 127.0.0.1:33110 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260811 18:58:07.729766 6025 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/krb5cc)
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:07.730706 6025 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:07.731454 6025 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.65@KRBTEST.COM
I20260811 18:58:07.737759 18149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:07.731918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33124 (local address 127.5.226.65:39031)
0811 18:58:07.731968 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:07.731970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:07.731997 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:58:07.732050 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:07.732051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:07.732060 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:07.732104 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:07.732427 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.732909 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.733584 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.733791 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.733837 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:07.735615 (+ 1778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:07.735617 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:07.735617 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:07.735624 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:07.736912 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.737164 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.737165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.737165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.737212 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.737396 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.737396 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.737396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.737482 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:07.737546 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:07.737620 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 18:58:07.737682 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 18:58:07.739144 18149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:07.738676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33130 (local address 127.5.226.65:39031)
0811 18:58:07.738714 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:07.738715 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:07.738738 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:58:07.738811 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:07.738812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:07.738821 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:07.738864 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:07.739101 (+ 237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33130: BlockingRecv error: recv got EOF from 127.0.0.1:33130 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 18:58:07.739236 6025 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474660766540-6025-0/krb5kdc/krb5cc' of type FILE
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:07.740119 6025 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:07.740895 6025 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[17076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.65@KRBTEST.COM
I20260811 18:58:07.746644 18149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:07.741360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33144 (local address 127.5.226.65:39031)
0811 18:58:07.741406 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:07.741408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:07.741435 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:58:07.741483 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:07.741484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:07.741490 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:07.741532 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:07.741840 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.742302 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.742897 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.743063 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.743103 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:07.744783 (+ 1680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:07.744785 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:07.744785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:07.744792 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:07.745846 (+ 1054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.746121 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.746122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.746122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.746162 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.746317 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.746318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.746318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.746391 (+ 73us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:07.746451 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:07.746521 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 18:58:07.746572 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 18:58:07.747236 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 17290
I20260811 18:58:07.764909 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 17592
I20260811 18:58:07.781034 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 17874
I20260811 18:58:07.792608 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 17115
2026-08-11T18:58:07Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2061 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[18175](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[18175](info): set up 2 sockets
Aug 11 18:58:07 dist-test-slave-gjw7 krb5kdc[18175](info): commencing operation
krb5kdc: starting...
W20260811 18:58:09.014950 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:58:09 dist-test-slave-gjw7 krb5kdc[18175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:58:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:09Z Disabled control of system clock
WARNING: no policy specified for oryx/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.126.keytab.
Entry for principal oryx/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.126.keytab.
I20260811 18:58:09.135622 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:40251
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.126.keytab
--principal=oryx/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:45253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:40251
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:09.217063 18210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:09.217275 18210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:09.217336 18210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:09.218501 18210 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:09.218542 18210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:09.218554 18210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:09.218577 18210 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:09.218600 18210 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:09.220120 18210 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:45253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:40251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.126.keytab
--principal=oryx/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:40251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:09.220373 18210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:09.220590 18210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:09.225456 18221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:09.225449 18220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:09.225428 18224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:09.225660 18210 server_base.cc:1034] running on GCE node
I20260811 18:58:09.225977 18210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:09.226265 18210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:09.227442 18210 hybrid_clock.cc:648] HybridClock initialized: now 1786474689227427 us; error 30 us; skew 500 ppm
Aug 11 18:58:09 dist-test-slave-gjw7 krb5kdc[18175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:09.229943 18210 init.cc:377] Logged in from keytab as oryx/127.5.226.126@KRBTEST.COM (short username oryx)
I20260811 18:58:09.230365 18210 webserver.cc:460] Webserver started at http://127.5.226.126:33851/ using document root <none> and password file <none>
I20260811 18:58:09.230556 18210 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:09.230597 18210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:09.230687 18210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:09.231717 18210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "911c5d267bfc4b6e86f00940f1def17a"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "fcafd63928da9d501aa14608da57c7ce"
server_key_iv: "594f57d21955b43a524a86e175bd1bfa"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.232019 18210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "911c5d267bfc4b6e86f00940f1def17a"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "fcafd63928da9d501aa14608da57c7ce"
server_key_iv: "594f57d21955b43a524a86e175bd1bfa"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.233206 18210 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:58:09.233956 18237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:09.234112 18210 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:09.234201 18210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "911c5d267bfc4b6e86f00940f1def17a"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "fcafd63928da9d501aa14608da57c7ce"
server_key_iv: "594f57d21955b43a524a86e175bd1bfa"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.234284 18210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:09.246622 18210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:09.248387 18210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:09.248519 18210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:09.252588 18210 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:40251
I20260811 18:58:09.252632 18347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:40251 every 8 connection(s)
I20260811 18:58:09.252954 18210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:09.253965 18348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:09.256237 18348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a: Bootstrap starting.
I20260811 18:58:09.256762 18348 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:09.257011 18348 log.cc:824] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:09.257709 18348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a: No bootstrap required, opened a new log
I20260811 18:58:09.259265 18348 raft_consensus.cc:348] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } }
I20260811 18:58:09.259409 18348 raft_consensus.cc:374] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:09.259431 18348 raft_consensus.cc:729] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 911c5d267bfc4b6e86f00940f1def17a, State: Initialized, Role: FOLLOWER
I20260811 18:58:09.259543 18348 consensus_queue.cc:260] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } }
I20260811 18:58:09.259619 18348 raft_consensus.cc:388] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:09.259644 18348 raft_consensus.cc:482] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:09.259676 18348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:09.260444 18348 raft_consensus.cc:504] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } }
I20260811 18:58:09.260560 18348 leader_election.cc:302] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 911c5d267bfc4b6e86f00940f1def17a; no voters:
I20260811 18:58:09.260630 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 18210
I20260811 18:58:09.260720 18348 leader_election.cc:288] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:09.260732 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:58:09.260794 18362 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:09.260934 6025 external_mini_cluster.cc:1428] Setting key d685fc1302f0b77a308b6c22f07dede4
I20260811 18:58:09.260982 18362 raft_consensus.cc:686] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [term 1 LEADER]: Becoming Leader. State: Replica: 911c5d267bfc4b6e86f00940f1def17a, State: Running, Role: LEADER
I20260811 18:58:09.260993 18348 sys_catalog.cc:564] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:09.261103 18362 consensus_queue.cc:237] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } }
I20260811 18:58:09.261570 18363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } }
I20260811 18:58:09.261652 18363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:09.261878 18376 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:09.261914 18368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 911c5d267bfc4b6e86f00940f1def17a. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } }
I20260811 18:58:09.262040 18368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:09.262444 18376 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:09.264279 18376 catalog_manager.cc:1347] Generated new cluster ID: b5b7aa57c00e4a80aa3997b7706d388c
I20260811 18:58:09.264336 18376 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:58:09 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:09.272495 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.261566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41642 (local address 127.5.226.126:40251)
0811 18:58:09.261727 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:09.261737 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:09.261773 (+ 36us) server_negotiation.cc:407] Connection header received
0811 18:58:09.261906 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:09.261914 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:09.261978 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:09.262908 (+ 930us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:09.263026 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.264280 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.265354 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.265950 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.266038 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.268830 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:09.268835 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:09.268835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:09.268849 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:09.270812 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.271209 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.271213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.271214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.271347 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.271546 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.271547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.271548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.271858 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:09.272015 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:09.272115 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 18:58:09.272270 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":59,"threads_started":1}
I20260811 18:58:09.272532 18376 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:09.273203 18376 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:09.277021 18376 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a: Generated new TSK 0
I20260811 18:58:09.277184 18376 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.65.keytab.
Entry for principal oryx/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.65.keytab.
I20260811 18:58:09.303826 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40251
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.65.keytab
--principal=oryx/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:45253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:09.387418 18401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:09.387626 18401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:09.387650 18401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:09.388792 18401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:09.388832 18401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:09.388856 18401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:58:09.390362 18401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:45253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.65.keytab
--principal=oryx/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:09.390597 18401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:09.390821 18401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:09.395576 18412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:09.395671 18418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:09.395612 18411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:09.395891 18401 server_base.cc:1034] running on GCE node
I20260811 18:58:09.396171 18401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:09.396415 18401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:09.397606 18401 hybrid_clock.cc:648] HybridClock initialized: now 1786474689397592 us; error 30 us; skew 500 ppm
Aug 11 18:58:09 dist-test-slave-gjw7 krb5kdc[18175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:09.400167 18401 init.cc:377] Logged in from keytab as oryx/127.5.226.65@KRBTEST.COM (short username oryx)
I20260811 18:58:09.400616 18401 webserver.cc:460] Webserver started at http://127.5.226.65:45555/ using document root <none> and password file <none>
I20260811 18:58:09.400825 18401 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:09.400874 18401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:09.401002 18401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:09.402132 18401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "e5de69080e7c484ea4acc681a8f4b27c"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "64d3ce97b8c0c6ef3a1acbe96bb24727"
server_key_iv: "7e1bf18b49c26d767e4ae44787c55372"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.402498 18401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "e5de69080e7c484ea4acc681a8f4b27c"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "64d3ce97b8c0c6ef3a1acbe96bb24727"
server_key_iv: "7e1bf18b49c26d767e4ae44787c55372"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.403728 18401 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:58:09.404388 18430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:09.404542 18401 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:09.404631 18401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "e5de69080e7c484ea4acc681a8f4b27c"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "64d3ce97b8c0c6ef3a1acbe96bb24727"
server_key_iv: "7e1bf18b49c26d767e4ae44787c55372"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.404690 18401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:09.440366 18401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:09.442414 18401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:09.442559 18401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:09.442793 18401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:09.443111 18401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:09.443145 18401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:09.443176 18401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:09.443210 18401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:09.448941 18401 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:43883
I20260811 18:58:09.449055 18648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:43883 every 8 connection(s)
I20260811 18:58:09.449395 18401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
Aug 11 18:58:09 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:09.458151 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.450206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:50699 (local address 127.5.226.126:40251)
0811 18:58:09.450272 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:09.450275 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:09.450504 (+ 229us) server_negotiation.cc:407] Connection header received
0811 18:58:09.451006 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:09.451007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:09.451022 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:09.451057 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:09.452011 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.452533 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.453486 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.453686 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.453736 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.455792 (+ 2056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:09.455794 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:09.455794 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:09.455801 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:09.456948 (+ 1147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.457354 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.457355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.457356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.457416 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.457618 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.457619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.457619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.457732 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:09.457779 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:09.458011 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 18:58:09.458082 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 18:58:09.458328 18655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.450192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.65:50699)
0811 18:58:09.450381 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:09.450421 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:09.450910 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:09.451123 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:09.451126 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:09.451718 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:09.451936 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.451941 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.452602 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.452603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.453418 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.453420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.453746 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.453747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.453846 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.454302 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:09.454325 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:09.455694 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:09.457019 (+ 1325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.457027 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.457029 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.457247 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.457465 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.457465 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.457466 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.457569 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.457777 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:09.457781 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:09.457909 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 18:58:09.457993 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 18:58:09.458116 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":92,"threads_started":1}
I20260811 18:58:09.458714 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 18401
I20260811 18:58:09.458817 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:58:09.458858 18651 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40251
I20260811 18:58:09.458963 18651 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:09.459028 6025 external_mini_cluster.cc:1428] Setting key 4ef9e4bd92eaecc51030e1c341986d0d
I20260811 18:58:09.459156 18651 heartbeater.cc:511] Master 127.5.226.126:40251 requested a full tablet report, sending...
I20260811 18:58:09.459689 18271 ts_manager.cc:194] Registered new tserver with Master: e5de69080e7c484ea4acc681a8f4b27c (127.5.226.65:43883)
I20260811 18:58:09.460342 18271 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:50699
WARNING: no policy specified for oryx/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.66.keytab.
Entry for principal oryx/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.66.keytab.
I20260811 18:58:09.484169 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40251
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.66.keytab
--principal=oryx/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:45253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:09.566825 18662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:09.567068 18662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:09.567093 18662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:09.568573 18662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:09.568637 18662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:09.568665 18662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:58:09.570825 18662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:45253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.66.keytab
--principal=oryx/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:09.571197 18662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:09.571446 18662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:09.576522 18674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:09.576620 18662 server_base.cc:1034] running on GCE node
W20260811 18:58:09.576534 18670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:09.576542 18669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:09.576978 18662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:09.577193 18662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:09.578336 18662 hybrid_clock.cc:648] HybridClock initialized: now 1786474689578317 us; error 35 us; skew 500 ppm
Aug 11 18:58:09 dist-test-slave-gjw7 krb5kdc[18175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:09.581041 18662 init.cc:377] Logged in from keytab as oryx/127.5.226.66@KRBTEST.COM (short username oryx)
I20260811 18:58:09.581539 18662 webserver.cc:460] Webserver started at http://127.5.226.66:34839/ using document root <none> and password file <none>
I20260811 18:58:09.581743 18662 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:09.581799 18662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:09.581931 18662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:09.582978 18662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "babe85aa167e43d5862fc6e79a8cd262"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "1a37dd61b93074122a49be74ff4861d4"
server_key_iv: "29a7a9503ab5617cada721f03c58cb6c"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.583323 18662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "babe85aa167e43d5862fc6e79a8cd262"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "1a37dd61b93074122a49be74ff4861d4"
server_key_iv: "29a7a9503ab5617cada721f03c58cb6c"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.584582 18662 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:58:09.585434 18686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:09.585587 18662 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:58:09.585685 18662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "babe85aa167e43d5862fc6e79a8cd262"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "1a37dd61b93074122a49be74ff4861d4"
server_key_iv: "29a7a9503ab5617cada721f03c58cb6c"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.585764 18662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:09.599304 18662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:09.601482 18662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:09.601621 18662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:09.601846 18662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:09.602202 18662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:09.602241 18662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:09.602270 18662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:09.602295 18662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:09.607863 18662 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:42467
I20260811 18:58:09.607928 18917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:42467 every 8 connection(s)
I20260811 18:58:09.608245 18662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 18:58:09.609633 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 18662
I20260811 18:58:09.609737 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:58:09.609957 6025 external_mini_cluster.cc:1428] Setting key 301df74b931a5e380063945ed5624bfe
Aug 11 18:58:09 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:09.618192 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.608918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:38349 (local address 127.5.226.126:40251)
0811 18:58:09.608969 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:09.608971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:09.609158 (+ 187us) server_negotiation.cc:407] Connection header received
0811 18:58:09.609736 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:09.609737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:09.609751 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:09.609816 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:09.611092 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.611637 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.612985 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.613186 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.613251 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.615357 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:09.615359 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:09.615359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:09.615368 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:09.616780 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.617261 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.617261 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.617262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.617334 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.617593 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.617593 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.617593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.617693 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:09.617739 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:09.618057 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 18:58:09.618127 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:58:09.618461 18925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.608889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.66:38349)
0811 18:58:09.609043 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:09.609079 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:09.609617 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:09.609961 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:09.609967 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:09.610669 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:09.610932 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.610940 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.611742 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.611754 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.612902 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.612905 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.613263 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.613264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.613425 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.613906 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:09.613916 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:09.615261 (+ 1345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:09.616862 (+ 1601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.616869 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.616871 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.617172 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.617386 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.617387 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.617387 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.617529 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.617747 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:09.617753 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:09.617924 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 18:58:09.618050 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 18:58:09.618230 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":88,"threads_started":1}
I20260811 18:58:09.618984 18919 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40251
I20260811 18:58:09.619079 18919 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:09.619256 18919 heartbeater.cc:511] Master 127.5.226.126:40251 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.5.226.67@KRBTEST.COM; defaulting to no policy
I20260811 18:58:09.619656 18271 ts_manager.cc:194] Registered new tserver with Master: babe85aa167e43d5862fc6e79a8cd262 (127.5.226.66:42467)
I20260811 18:58:09.620015 18271 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:38349
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.67.keytab.
Entry for principal oryx/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.67.keytab.
I20260811 18:58:09.636583 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40251
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.67.keytab
--principal=oryx/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:45253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:09.719525 18933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:09.719732 18933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:09.719755 18933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:09.720832 18933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:09.720865 18933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:09.720889 18933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:58:09.722338 18933 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:45253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.67.keytab
--principal=oryx/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:09.722527 18933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:09.722702 18933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:09.727519 18945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:09.727661 18949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:09.727528 18946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:09.727617 18933 server_base.cc:1034] running on GCE node
I20260811 18:58:09.727919 18933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:09.728152 18933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:09.729327 18933 hybrid_clock.cc:648] HybridClock initialized: now 1786474689729307 us; error 32 us; skew 500 ppm
Aug 11 18:58:09 dist-test-slave-gjw7 krb5kdc[18175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:09.731722 18933 init.cc:377] Logged in from keytab as oryx/127.5.226.67@KRBTEST.COM (short username oryx)
I20260811 18:58:09.732138 18933 webserver.cc:460] Webserver started at http://127.5.226.67:45691/ using document root <none> and password file <none>
I20260811 18:58:09.732343 18933 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:09.732391 18933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:09.732515 18933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:09.733596 18933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "e9b1653b2a2744e58a67f59323c5c143"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "3bbece44e9ce9f989988c1a61b510ea0"
server_key_iv: "703e069d9a05ba55e633086f413844f2"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.733958 18933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "e9b1653b2a2744e58a67f59323c5c143"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "3bbece44e9ce9f989988c1a61b510ea0"
server_key_iv: "703e069d9a05ba55e633086f413844f2"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.735303 18933 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:58:09.736001 18958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:09.736176 18933 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:09.736264 18933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "e9b1653b2a2744e58a67f59323c5c143"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "3bbece44e9ce9f989988c1a61b510ea0"
server_key_iv: "703e069d9a05ba55e633086f413844f2"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.736328 18933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:09.758903 18933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:09.760828 18933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:09.760964 18933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:09.761209 18933 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:09.761574 18933 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:09.761626 18933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:09.761691 18933 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:09.761715 18933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:09.767474 18933 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:46209
I20260811 18:58:09.767532 19189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:46209 every 8 connection(s)
I20260811 18:58:09.767856 18933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:09.772354 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 18933
I20260811 18:58:09.772455 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:58:09.772655 6025 external_mini_cluster.cc:1428] Setting key 1194e46ec3e4b5b2b3a2eb8c317b248a
Aug 11 18:58:09 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:09.777081 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.768607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:51407 (local address 127.5.226.126:40251)
0811 18:58:09.768701 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:09.768703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:09.768856 (+ 153us) server_negotiation.cc:407] Connection header received
0811 18:58:09.769461 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:09.769463 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:09.769477 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:09.769523 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:09.770543 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.771047 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.772026 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.772246 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.772303 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.774619 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:09.774621 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:09.774621 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:09.774628 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:09.775919 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.776260 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.776261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.776261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.776334 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.776570 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.776570 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.776571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.776681 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:09.776732 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:09.776954 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 18:58:09.777016 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 18:58:09.777269 19194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.768534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.67:51407)
0811 18:58:09.768726 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:09.768774 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:09.769346 (+ 572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:09.769602 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:09.769606 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:09.770217 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:09.770441 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.770447 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.771135 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.771136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.771939 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.771941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.772320 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.772321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.772444 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.772988 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:09.772999 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:09.774536 (+ 1537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:09.775980 (+ 1444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.775983 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.775985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.776180 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.776408 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.776409 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.776409 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.776520 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.776727 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:09.776730 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:09.776854 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 18:58:09.776931 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 18:58:09.777057 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
I20260811 18:58:09.777788 19190 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40251
I20260811 18:58:09.777890 19190 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:09.778071 19190 heartbeater.cc:511] Master 127.5.226.126:40251 requested a full tablet report, sending...
I20260811 18:58:09.778450 18271 ts_manager.cc:194] Registered new tserver with Master: e9b1653b2a2744e58a67f59323c5c143 (127.5.226.67:46209)
I20260811 18:58:09.778815 18271 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:51407
I20260811 18:58:09.784314 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.5.226.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.226.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.226.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.125.keytab.
Entry for principal oryx/127.5.226.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.125.keytab.
I20260811 18:58:09.812263 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.125:45205
--webserver_interface=127.5.226.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.125.keytab
--principal=oryx/127.5.226.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:45253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:40251,127.5.226.125:45205
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:09.900396 19198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:09.900758 19198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:09.900799 19198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:09.902503 19198 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:09.902551 19198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:09.902566 19198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:09.902580 19198 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:09.902592 19198 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:09.904325 19198 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:45253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:40251,127.5.226.125:45205
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.125.keytab
--principal=oryx/127.5.226.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.125:45205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.226.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
W20260811 18:58:09.904453 19198 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.5.226.126:40251,127.5.226.125:45205'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 18:58:09.904604 19198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:09.904817 19198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:09.910135 19209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:09.910145 19210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:09.910135 19212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:09.910547 19198 server_base.cc:1034] running on GCE node
I20260811 18:58:09.910809 19198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:09.911132 19198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:09.914387 19198 hybrid_clock.cc:648] HybridClock initialized: now 1786474689914367 us; error 32 us; skew 500 ppm
Aug 11 18:58:09 dist-test-slave-gjw7 krb5kdc[18175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:09.917238 19198 init.cc:377] Logged in from keytab as oryx/127.5.226.125@KRBTEST.COM (short username oryx)
I20260811 18:58:09.917691 19198 webserver.cc:460] Webserver started at http://127.5.226.125:45881/ using document root <none> and password file <none>
I20260811 18:58:09.917900 19198 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:09.917946 19198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:09.918072 19198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:09.919127 19198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/data/instance:
uuid: "07b619355bda44889924c86231d34c3b"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "b541d3afe6ec406426be2a85fb99984e"
server_key_iv: "6a870490ac00e7e055209180f2406f95"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.919474 19198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/wal/instance:
uuid: "07b619355bda44889924c86231d34c3b"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "b541d3afe6ec406426be2a85fb99984e"
server_key_iv: "6a870490ac00e7e055209180f2406f95"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.920717 19198 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:58:09.921376 19224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:09.921515 19198 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:09.921603 19198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/wal
uuid: "07b619355bda44889924c86231d34c3b"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "b541d3afe6ec406426be2a85fb99984e"
server_key_iv: "6a870490ac00e7e055209180f2406f95"
server_key_version: "encryptionkey@0"
I20260811 18:58:09.921672 19198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:09.940855 19198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:09.942848 19198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:09.942991 19198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:09.946810 19198 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.125:45205
I20260811 18:58:09.946853 19333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.125:45205 every 8 connection(s)
I20260811 18:58:09.947177 19198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/data/info.pb
I20260811 18:58:09.948042 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 19198
I20260811 18:58:09.948144 19334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:09.950496 19334 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:58:09 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.226.125@KRBTEST.COM
Aug 11 18:58:09 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.125@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:09.958276 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.951229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34892 (local address 127.5.226.126:40251)
0811 18:58:09.951284 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:09.951286 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:09.951444 (+ 158us) server_negotiation.cc:407] Connection header received
0811 18:58:09.951517 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:09.951518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:09.951532 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:09.951578 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:09.952049 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.952550 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.953421 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.953685 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.953778 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.955840 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:09.955842 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:09.955842 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:09.955850 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:09.957038 (+ 1188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.957422 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.957424 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.957424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.957480 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.957684 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.957685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.957685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.957842 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:09.957904 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:09.958105 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 18:58:09.958188 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 18:58:09.958441 19341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.951168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:34892)
0811 18:58:09.951344 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:09.951381 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:09.951449 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:09.951618 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:09.951621 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:09.951894 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:09.951962 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.951964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.952656 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.952657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.953334 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.953338 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.953784 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.953785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.953844 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.954253 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:09.954262 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:09.955757 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:09.957110 (+ 1353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.957118 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.957120 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.957358 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.957534 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.957535 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.957535 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.957629 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.957904 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:09.957911 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:09.958001 (+ 90us) client_negotiation.cc:769] Sending connection context
0811 18:58:09.958079 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 18:58:09.958235 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":96,"threads_started":1}
I20260811 18:58:09.958534 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.948869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53596 (local address 127.5.226.125:45205)
0811 18:58:09.949047 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:09.949056 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:09.949081 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:58:09.949678 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:09.949687 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:09.949741 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:09.949853 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:09.950707 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.951769 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.952497 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.952898 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.953005 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.955404 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:09.955412 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:09.955413 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:09.955420 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:09.957068 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.957488 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.957491 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.957491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.957584 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.957787 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.957787 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.957788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.957995 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:09.958164 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:09.958248 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 18:58:09.958327 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":85,"threads_started":1}
I20260811 18:58:09.959059 19334 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:58:09 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.125@KRBTEST.COM for oryx/127.5.226.125@KRBTEST.COM
I20260811 18:58:09.964669 19341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.959343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45205 (local address 127.0.0.1:53606)
0811 18:58:09.959380 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:09.959389 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:09.959422 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:09.959515 (+ 93us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:09.959516 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:09.959633 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:09.959659 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.959660 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.960225 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.960225 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.960672 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.960673 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.960989 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.960990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.961047 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.961454 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:09.961458 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:09.962591 (+ 1133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:09.963977 (+ 1386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.963978 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.963978 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.964126 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.964271 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.964272 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.964272 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.964315 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.964460 (+ 145us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:09.964461 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:09.964489 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 18:58:09.964530 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 18:58:09.964595 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 18:58:09.964727 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.959399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53606 (local address 127.5.226.125:45205)
0811 18:58:09.959431 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:09.959433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:09.959441 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:58:09.959459 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:09.959459 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:09.959466 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:09.959504 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:09.959722 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.960155 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.960740 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.960934 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.960984 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.962676 (+ 1692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:09.962677 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:09.962677 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:09.962683 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:09.963908 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.964181 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.964181 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.964181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.964228 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.964347 (+ 119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.964347 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.964348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.964428 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:09.964467 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:09.964546 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 18:58:09.964636 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":18}
I20260811 18:58:09.965982 19334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: Bootstrap starting.
I20260811 18:58:09.966739 19334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:09.966962 19334 log.cc:824] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:09.967612 19334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: No bootstrap required, opened a new log
I20260811 18:58:09.968935 19334 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } }
I20260811 18:58:09.969053 19334 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:09.969082 19334 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07b619355bda44889924c86231d34c3b, State: Initialized, Role: FOLLOWER
I20260811 18:58:09.969182 19334 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } }
I20260811 18:58:09.969489 19334 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:09.969480 19346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } } }
I20260811 18:58:09.969588 19346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: This master's current role is: FOLLOWER
W20260811 18:58:09.971019 19363 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:58:09.971072 19363 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:58:09.972801 19198 master_runner.cc:428] Detected that this master 07b619355bda44889924c86231d34c3b is joining an existing cluster
I20260811 18:58:09.972906 19198 master_runner.cc:432] Initiating AddMaster RPC to add 127.5.226.125:45205
I20260811 18:58:09.980245 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.973993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34896 (local address 127.5.226.126:40251)
0811 18:58:09.974069 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:09.974071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:09.974290 (+ 219us) server_negotiation.cc:407] Connection header received
0811 18:58:09.974375 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:09.974376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:09.974387 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:09.974440 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:09.974773 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.975242 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.976251 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.976579 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.976649 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.977730 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:09.977732 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:09.977732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:09.977738 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:09.979151 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.979519 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.979520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.979521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.979584 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.979734 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.979735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.979735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.979859 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:09.979919 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:09.980092 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 18:58:09.980165 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 18:58:09.980233 19382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.973952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45205 (local address 127.0.0.1:53610)
0811 18:58:09.974114 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:09.974122 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:09.974170 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:09.974326 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:09.974327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:09.974553 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:09.974638 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.974639 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.975512 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.975513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.976307 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.976309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.976613 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.976614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.976669 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.977054 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:09.977059 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:09.977521 (+ 462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:09.979115 (+ 1594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.979116 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.979117 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.979409 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.979590 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.979591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.979591 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.979644 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.979896 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:09.979897 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:09.979937 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 18:58:09.980001 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 18:58:09.980103 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":77,"threads_started":1}
I20260811 18:58:09.980294 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.974028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53610 (local address 127.5.226.125:45205)
0811 18:58:09.974097 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:09.974099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:09.974166 (+ 67us) server_negotiation.cc:407] Connection header received
0811 18:58:09.974212 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:09.974213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:09.974223 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:09.974290 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:09.974722 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.975411 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.976366 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.976551 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.976599 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.977591 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:09.977593 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:09.977593 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:09.977599 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:09.979027 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.979482 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.979484 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.979484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.979538 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.979695 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.979696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.979697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.979832 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:09.979894 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:09.980033 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 18:58:09.980164 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":54}
I20260811 18:58:09.981006 19377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.973964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:34896)
0811 18:58:09.974228 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:09.974235 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:09.974273 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:09.974460 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:09.974461 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:09.974619 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:09.974665 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.974666 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.975317 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.975317 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.976168 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.976171 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.976720 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.976722 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.976789 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.977185 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:09.977189 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:09.977643 (+ 454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:09.979212 (+ 1569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.979213 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.979213 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.979427 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.979638 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.979638 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.979639 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.979684 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.979950 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:09.979951 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:09.979982 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 18:58:09.980813 (+ 831us) client_negotiation.cc:240] Negotiation successful
0811 18:58:09.980916 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"spinlock_wait_cycles":11136,"thread_start_us":88,"threads_started":1}
Aug 11 18:58:09 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.126@KRBTEST.COM for oryx/127.5.226.125@KRBTEST.COM
I20260811 18:58:09.989981 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.983095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53618 (local address 127.5.226.125:45205)
0811 18:58:09.983133 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:09.983135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:09.983232 (+ 97us) server_negotiation.cc:407] Connection header received
0811 18:58:09.983341 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:09.983341 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:09.983348 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:09.983391 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:09.983924 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.984341 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.985453 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.985624 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.985670 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.987649 (+ 1979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:09.987650 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:09.987650 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:09.987656 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:09.988820 (+ 1164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.989236 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.989237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.989237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.989324 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:09.989553 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:09.989554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:09.989554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:09.989647 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:09.989695 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:09.989869 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 18:58:09.989920 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:58:09.990080 19384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.983004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45205 (local address 127.0.0.1:53618)
0811 18:58:09.983128 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:09.983169 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:09.983249 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:09.983441 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:09.983451 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:09.983797 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:09.983854 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.983856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.984407 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.984408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.985385 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:09.985388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:09.985690 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:09.985691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:09.985779 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:09.986135 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:09.986140 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:09.987575 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:09.988888 (+ 1313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.988896 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.988898 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.989168 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.989377 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:09.989378 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:09.989378 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:09.989497 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:09.989708 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:09.989715 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:09.989769 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 18:58:09.989854 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 18:58:09.989967 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":69,"threads_started":1}
I20260811 18:58:09.990633 18271 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.5.226.125:45205: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "07b619355bda44889924c86231d34c3b"
member_type: NON_VOTER
last_known_addr {
host: "127.5.226.125"
port: 45205
}
attrs {
promote: true
}
}
dest_uuid: "911c5d267bfc4b6e86f00940f1def17a"
cas_config_opid_index: -1
I20260811 18:58:09.991020 18271 consensus_queue.cc:237] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: NON_VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: true } }
I20260811 18:58:09.991509 19390 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 07b619355bda44889924c86231d34c3b (127.5.226.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: NON_VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: true } } }
I20260811 18:58:09.991751 19285 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:09.992451 19285 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 FOLLOWER]: Refusing update from remote peer 911c5d267bfc4b6e86f00940f1def17a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 18:58:09.992479 19390 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.5.226.125:45205
I20260811 18:58:09.992569 19387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: NON_VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: true } } }
I20260811 18:58:09.992820 19198 master.cc:537] Master@127.5.226.125:45205 shutting down...
I20260811 18:58:09.992834 19387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:09.993088 19387 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: NON_VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 18:58:09.994174 18242 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 18:58:09.994660 18242 consensus_peers.cc:487] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a -> Peer 07b619355bda44889924c86231d34c3b (127.5.226.125:45205): Couldn't send request to peer 07b619355bda44889924c86231d34c3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 18:58:09.995829 19198 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:09.995929 19198 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:09.995981 19198 tablet_replica.cc:330] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: stopping tablet replica
I20260811 18:58:10.009245 19198 master.cc:552] Master@127.5.226.125:45205 shutdown complete.
I20260811 18:58:10.009331 19198 master_runner.cc:305] Clearing existing system tablet
I20260811 18:58:10.009459 19198 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:10.009502 19198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:10.010154 19198 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:10.010596 19401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.010718 19198 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:10.010787 19198 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.010812 19198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/wal
uuid: "07b619355bda44889924c86231d34c3b"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "b541d3afe6ec406426be2a85fb99984e"
server_key_iv: "6a870490ac00e7e055209180f2406f95"
server_key_version: "encryptionkey@0"
I20260811 18:58:10.011742 19198 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:10.013208 19198 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 18:58:10.013283 19198 log.cc:1196] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 18:58:10.013605 19198 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: Deleting consensus metadata
I20260811 18:58:10.013756 19198 master_runner.cc:315] Copying system tablet from 127.5.226.126:40251
I20260811 18:58:10.014381 19198 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: tablet copy: Beginning tablet copy session from remote peer at address 127.5.226.126:40251
I20260811 18:58:10.020591 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.014813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34898 (local address 127.5.226.126:40251)
0811 18:58:10.014856 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.014858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.014893 (+ 35us) server_negotiation.cc:407] Connection header received
0811 18:58:10.014982 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.014983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.014993 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.015028 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.015381 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.015882 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.016951 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.017141 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.017190 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.018184 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.018185 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.018185 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.018192 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.019562 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.019927 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.019928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.019928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.019981 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.020147 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.020148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.020148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.020249 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.020311 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.020464 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.020526 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 18:58:10.020666 19410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.014710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:34898)
0811 18:58:10.014828 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.014839 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.014911 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.015037 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.015038 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.015241 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.015316 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.015319 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.015954 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.015956 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.016872 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.016875 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.017207 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.017208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.017276 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.017716 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.017721 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.018103 (+ 382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.019635 (+ 1532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.019636 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.019637 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.019864 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.020031 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.020031 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.020032 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.020095 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.020307 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.020308 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.020361 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.020448 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.020557 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":73,"threads_started":1}
I20260811 18:58:10.021090 18315 tablet_copy_service.cc:140] P 911c5d267bfc4b6e86f00940f1def17a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 07b619355bda44889924c86231d34c3b ({username='oryx', principal='oryx/127.5.226.125@KRBTEST.COM'} at 127.0.0.1:34898)
I20260811 18:58:10.021220 18315 tablet_copy_service.cc:161] P 911c5d267bfc4b6e86f00940f1def17a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 07b619355bda44889924c86231d34c3b at {username='oryx', principal='oryx/127.5.226.125@KRBTEST.COM'} at 127.0.0.1:34898: session id = 07b619355bda44889924c86231d34c3b-00000000000000000000000000000000
I20260811 18:58:10.021988 18315 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 18:58:10.022632 19198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 18:58:10.023991 19198 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: tablet copy: Starting download of 0 data blocks...
I20260811 18:58:10.024144 19198 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: tablet copy: Starting download of 1 WAL segments...
I20260811 18:58:10.025063 19198 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 18:58:10.026053 18315 tablet_copy_service.cc:342] P 911c5d267bfc4b6e86f00940f1def17a: Request end of tablet copy session 07b619355bda44889924c86231d34c3b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.5.226.125@KRBTEST.COM'} at 127.0.0.1:34898
I20260811 18:58:10.026105 18315 tablet_copy_service.cc:433] P 911c5d267bfc4b6e86f00940f1def17a: ending tablet copy session 07b619355bda44889924c86231d34c3b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 07b619355bda44889924c86231d34c3b
I20260811 18:58:10.028941 19198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:10.029999 19417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:10.030053 19418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:10.034027 19423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:10.034286 19198 server_base.cc:1034] running on GCE node
I20260811 18:58:10.034389 19198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:10.034525 19198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:10.035637 19198 hybrid_clock.cc:648] HybridClock initialized: now 1786474690035628 us; error 24 us; skew 500 ppm
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:10.037107 19198 init.cc:377] Logged in from keytab as oryx/127.5.226.125@KRBTEST.COM (short username oryx)
I20260811 18:58:10.037427 19198 webserver.cc:460] Webserver started at http://127.5.226.125:35985/ using document root <none> and password file <none>
I20260811 18:58:10.037560 19198 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:10.037600 19198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:10.038319 19198 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:10.038862 19443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.039007 19198 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:10.039060 19198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/wal
uuid: "07b619355bda44889924c86231d34c3b"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "b541d3afe6ec406426be2a85fb99984e"
server_key_iv: "6a870490ac00e7e055209180f2406f95"
server_key_version: "encryptionkey@0"
I20260811 18:58:10.039168 19198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:10.045673 19198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:10.047289 19198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:10.050406 19198 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.125:45205
I20260811 18:58:10.050429 19549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.125:45205 every 8 connection(s)
I20260811 18:58:10.050729 19198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-1/data/info.pb
I20260811 18:58:10.051497 19550 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:58:10.051939 19550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: Bootstrap starting.
I20260811 18:58:10.054590 19550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:58:10.054813 19550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: Bootstrap complete.
I20260811 18:58:10.055002 19550 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: NON_VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: true } }
I20260811 18:58:10.055078 19550 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 07b619355bda44889924c86231d34c3b, State: Initialized, Role: LEARNER
I20260811 18:58:10.055117 19550 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: NON_VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: true } }
I20260811 18:58:10.055313 19550 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:10.055279 19556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: NON_VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: true } } }
I20260811 18:58:10.055372 19556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: This master's current role is: LEARNER
I20260811 18:58:10.056699 19573 catalog_manager.cc:1259] Loaded cluster ID: b5b7aa57c00e4a80aa3997b7706d388c
I20260811 18:58:10.056749 19573 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: loading cluster ID for follower catalog manager: success
I20260811 18:58:10.058049 19573 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: acquiring CA information for follower catalog manager: success
I20260811 18:58:10.058331 19573 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:58:10.066646 19577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.060101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53624 (local address 127.5.226.125:45205)
0811 18:58:10.060218 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.060221 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.060229 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:58:10.060255 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.060255 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.060265 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.060329 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.060853 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.061633 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.062409 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.062613 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.062670 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.064071 (+ 1401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.064073 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.064073 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.064080 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.065535 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.065922 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.065923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.065923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.065978 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.066191 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.066191 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.066191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.066290 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.066367 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.066510 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.066573 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":54,"threads_started":1}
WARNING: no policy specified for oryx/127.5.226.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.226.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.226.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.124.keytab.
Entry for principal oryx/127.5.226.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.124.keytab.
I20260811 18:58:10.092221 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.124:38837
--webserver_interface=127.5.226.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.124.keytab
--principal=oryx/127.5.226.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:45253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:40251,127.5.226.125:45205,127.5.226.124:38837
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:10.175091 19581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:10.175289 19581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:10.175319 19581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:10.176448 19581 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:10.176487 19581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:10.176504 19581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:10.176520 19581 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:10.176535 19581 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:10.178088 19581 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:45253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:40251,127.5.226.125:45205,127.5.226.124:38837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.124.keytab
--principal=oryx/127.5.226.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.124:38837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.226.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:10.178329 19581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:10.178543 19581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:10.183035 19591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:10.183049 19592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:10.183104 19581 server_base.cc:1034] running on GCE node
W20260811 18:58:10.183055 19597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:10.183566 19581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:10.183845 19581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:10.184983 19581 hybrid_clock.cc:648] HybridClock initialized: now 1786474690184967 us; error 38 us; skew 500 ppm
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:10.187469 19581 init.cc:377] Logged in from keytab as oryx/127.5.226.124@KRBTEST.COM (short username oryx)
I20260811 18:58:10.187868 19581 webserver.cc:460] Webserver started at http://127.5.226.124:36991/ using document root <none> and password file <none>
I20260811 18:58:10.188061 19581 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:10.188099 19581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:10.188189 19581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:10.189242 19581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/data/instance:
uuid: "db898a8a682046afac193ba713c7d0fd"
format_stamp: "Formatted at 2026-08-11 18:58:10 on dist-test-slave-gjw7"
server_key: "13b88a1426fedba81e9810951037aeb4"
server_key_iv: "20935910f16674bfa0a6f40a95e0d1d8"
server_key_version: "encryptionkey@0"
I20260811 18:58:10.189651 19581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/wal/instance:
uuid: "db898a8a682046afac193ba713c7d0fd"
format_stamp: "Formatted at 2026-08-11 18:58:10 on dist-test-slave-gjw7"
server_key: "13b88a1426fedba81e9810951037aeb4"
server_key_iv: "20935910f16674bfa0a6f40a95e0d1d8"
server_key_version: "encryptionkey@0"
I20260811 18:58:10.190852 19581 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:10.191516 19605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.191684 19581 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:10.191771 19581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/wal
uuid: "db898a8a682046afac193ba713c7d0fd"
format_stamp: "Formatted at 2026-08-11 18:58:10 on dist-test-slave-gjw7"
server_key: "13b88a1426fedba81e9810951037aeb4"
server_key_iv: "20935910f16674bfa0a6f40a95e0d1d8"
server_key_version: "encryptionkey@0"
I20260811 18:58:10.191828 19581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:10.219130 19581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:10.220961 19581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:10.221073 19581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:10.225597 19581 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.124:38837
I20260811 18:58:10.225637 19717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.124:38837 every 8 connection(s)
I20260811 18:58:10.225983 19581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/data/info.pb
I20260811 18:58:10.226945 19719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:10.228344 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 19581
I20260811 18:58:10.228533 19719 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.124@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.226.124@KRBTEST.COM
I20260811 18:58:10.238265 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.229355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34902 (local address 127.5.226.126:40251)
0811 18:58:10.229399 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.229401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.229443 (+ 42us) server_negotiation.cc:407] Connection header received
0811 18:58:10.229837 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.229838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.229850 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.229909 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.230651 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.231436 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.232674 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.232981 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.233037 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.235443 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.235445 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.235445 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.235453 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.236873 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.237325 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.237327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.237327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.237391 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.237641 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.237642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.237642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.237768 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.237829 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.238094 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.238177 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:58:10.238458 19722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.229152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:34902)
0811 18:58:10.229319 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.229357 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.229745 (+ 388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.229938 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.229941 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.230338 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.230575 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.230581 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.231528 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.231529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.232582 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.232585 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.233070 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.233071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.233159 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.233804 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.233814 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.235357 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.236952 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.236959 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.236961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.237236 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.237447 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.237447 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.237448 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.237584 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.237830 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.237837 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.237970 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.238061 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.238222 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":65,"threads_started":1}
I20260811 18:58:10.238837 19721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.228965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47616 (local address 127.5.226.124:38837)
0811 18:58:10.229149 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.229159 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.229193 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:58:10.229738 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.229746 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.229768 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.229863 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.230566 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.231716 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.232662 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.233131 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.233177 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.235791 (+ 2614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.235799 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.235799 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.235806 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.237406 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.237762 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.237765 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.237765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.237821 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.237999 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.237999 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.238000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.238133 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.238265 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.238679 (+ 414us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.238744 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":99,"threads_started":1}
I20260811 18:58:10.239104 19719 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.124@KRBTEST.COM for oryx/127.5.226.125@KRBTEST.COM
I20260811 18:58:10.244846 19722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.239418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45205 (local address 127.0.0.1:53632)
0811 18:58:10.239452 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.239463 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.239536 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.239674 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.239675 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.239806 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.239844 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.239846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.240501 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.240502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.240991 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.240992 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.241278 (+ 286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.241278 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.241363 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.241654 (+ 291us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.241657 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.242712 (+ 1055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.244064 (+ 1352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.244065 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.244065 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.244199 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.244340 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.244340 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.244341 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.244382 (+ 41us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.244643 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.244644 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.244675 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.244722 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.244787 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 18:58:10.244870 19577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.239480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53632 (local address 127.5.226.125:45205)
0811 18:58:10.239522 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.239524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.239533 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:10.239589 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.239590 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.239602 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.239660 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.239898 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.240442 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.241045 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.241231 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.241272 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.242791 (+ 1519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.242793 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.242794 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.242801 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.244003 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.244254 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.244255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.244255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.244298 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.244420 (+ 122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.244420 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.244421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.244599 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.244648 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.244745 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.244808 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:58:10.245254 19719 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.124@KRBTEST.COM for oryx/127.5.226.124@KRBTEST.COM
I20260811 18:58:10.250454 19722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.245503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:38837 (local address 127.0.0.1:47632)
0811 18:58:10.245545 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.245554 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.245590 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.245677 (+ 87us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.245678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.245789 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.245818 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.245819 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.246344 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.246345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.246792 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.246793 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.247068 (+ 275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.247069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.247100 (+ 31us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.247380 (+ 280us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.247384 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.248389 (+ 1005us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.249606 (+ 1217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.249606 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.249607 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.249753 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.249927 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.249928 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.249928 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.249980 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.250172 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.250173 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.250207 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.250260 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.250349 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 18:58:10.250507 19721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.245528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47632 (local address 127.5.226.124:38837)
0811 18:58:10.245571 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.245573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.245582 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:10.245625 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.245626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.245633 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.245667 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.245860 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.246292 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.246844 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.247024 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.247064 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.248457 (+ 1393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.248458 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.248459 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.248464 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.249532 (+ 1068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.249817 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.249819 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.249819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.249875 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.250029 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.250030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.250030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.250122 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.250174 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.250286 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.250409 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":25}
I20260811 18:58:10.251730 19719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: Bootstrap starting.
I20260811 18:58:10.252585 19719 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:10.252856 19719 log.cc:824] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:10.253621 19719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: No bootstrap required, opened a new log
I20260811 18:58:10.255012 19719 raft_consensus.cc:348] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } }
I20260811 18:58:10.255178 19719 raft_consensus.cc:374] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:10.255225 19719 raft_consensus.cc:729] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db898a8a682046afac193ba713c7d0fd, State: Initialized, Role: FOLLOWER
I20260811 18:58:10.255345 19719 consensus_queue.cc:260] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } }
I20260811 18:58:10.255642 19724 sys_catalog.cc:455] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } } }
I20260811 18:58:10.255692 19719 sys_catalog.cc:564] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:10.255735 19724 sys_catalog.cc:458] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [sys.catalog]: This master's current role is: FOLLOWER
W20260811 18:58:10.257474 19745 catalog_manager.cc:1558] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:58:10.257520 19745 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:58:10.259733 19581 master_runner.cc:428] Detected that this master db898a8a682046afac193ba713c7d0fd is joining an existing cluster
I20260811 18:58:10.259774 19581 master_runner.cc:432] Initiating AddMaster RPC to add 127.5.226.124:38837
I20260811 18:58:10.267156 19577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.261218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53642 (local address 127.5.226.125:45205)
0811 18:58:10.261256 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.261258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.261640 (+ 382us) server_negotiation.cc:407] Connection header received
0811 18:58:10.261672 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.261673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.261684 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.261742 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.262111 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.262620 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.263409 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.263602 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.263656 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.264668 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.264670 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.264670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.264691 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.266118 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.266459 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.266460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.266460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.266519 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.266684 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.266685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.266685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.266797 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.266853 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.266985 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.267069 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 18:58:10.267696 19764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.261021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45205 (local address 127.0.0.1:53642)
0811 18:58:10.261567 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.261576 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.261633 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.261746 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.261747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.261993 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.262044 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.262045 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.262692 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.262693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.263327 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.263329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.263672 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.263673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.263733 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.264116 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.264121 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.264436 (+ 315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.266206 (+ 1770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.266207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.266208 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.266391 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.266573 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.266574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.266574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.266633 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.266851 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.266852 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.266897 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.266956 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.267069 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":116,"threads_started":1}
I20260811 18:58:10.268322 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.261213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34914 (local address 127.5.226.126:40251)
0811 18:58:10.261256 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.261258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.261268 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:58:10.261433 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.261434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.261447 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.261476 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.261981 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.262748 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.263817 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.264132 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.264175 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.265342 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.265343 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.265344 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.265351 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.266852 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.267407 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.267408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.267409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.267471 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.267671 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.267672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.267672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.267795 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.267835 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.268154 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.268235 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:58:10.268719 19760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.261011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:34914)
0811 18:58:10.261205 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.261216 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.261267 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.261546 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.261547 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.261825 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.261907 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.261909 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.262838 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.262839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.263719 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.263721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.264255 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.264256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.264324 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.264820 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.264824 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.265208 (+ 384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.266943 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.266943 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.266944 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.267191 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.267540 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.267541 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.267541 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.267607 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.267986 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.267987 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.268043 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.268505 (+ 462us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.268615 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":91,"threads_started":1}
I20260811 18:58:10.274312 19764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.261275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:38837 (local address 127.0.0.1:47638)
0811 18:58:10.267764 (+ 6489us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.267776 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.267844 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.268120 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.268121 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.268270 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.268321 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.268323 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.269059 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.269060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.269874 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.269877 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.270407 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.270408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.270471 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.271227 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.271231 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.271548 (+ 317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.273246 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.273247 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.273248 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.273492 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.273678 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.273679 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.273679 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.273737 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.274003 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.274004 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.274036 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.274090 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.274186 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6478,"thread_start_us":148,"threads_started":1}
I20260811 18:58:10.274387 19721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.261493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47638 (local address 127.5.226.124:38837)
0811 18:58:10.261526 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.261527 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.267821 (+ 6294us) server_negotiation.cc:407] Connection header received
0811 18:58:10.268033 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.268034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.268044 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.268070 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.268387 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.268982 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.269945 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.270336 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.270405 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.271623 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.271624 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.271624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.271631 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.273155 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.273560 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.273561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.273562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.273622 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.273804 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.273805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.273805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.273925 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.273983 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.274150 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.274235 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":17}
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474689, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.126@KRBTEST.COM for oryx/127.5.226.124@KRBTEST.COM
I20260811 18:58:10.278043 19765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.270792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47644 (local address 127.5.226.124:38837)
0811 18:58:10.271093 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.271095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.271121 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:58:10.271221 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.271222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.271233 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.271294 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.271605 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.272348 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.273278 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.273518 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.273820 (+ 302us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.275636 (+ 1816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.275637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.275637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.275643 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.276921 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.277323 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.277325 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.277325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.277409 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.277607 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.277608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.277608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.277710 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.277768 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.277902 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.277966 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":234,"threads_started":1}
I20260811 18:58:10.278087 19384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.270764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:38837 (local address 127.0.0.1:47644)
0811 18:58:10.271074 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.271086 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.271137 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.271315 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.271316 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.271485 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.271530 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.271532 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.272409 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.272410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.273199 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.273202 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.273598 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.273599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.273690 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.274040 (+ 350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.274045 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.275538 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.276995 (+ 1457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.276996 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.276997 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.277205 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.277479 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.277480 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.277481 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.277545 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.277771 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.277772 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.277817 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.277886 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.277987 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287}
I20260811 18:58:10.278501 18271 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.5.226.124:38837: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "db898a8a682046afac193ba713c7d0fd"
member_type: NON_VOTER
last_known_addr {
host: "127.5.226.124"
port: 38837
}
attrs {
promote: true
}
}
dest_uuid: "911c5d267bfc4b6e86f00940f1def17a"
cas_config_opid_index: 5
I20260811 18:58:10.278753 18271 consensus_queue.cc:237] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: NON_VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: true } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } }
I20260811 18:58:10.279089 19390 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER db898a8a682046afac193ba713c7d0fd (127.5.226.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: NON_VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: true } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } } }
I20260811 18:58:10.279536 19665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:10.280035 19390 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.5.226.124:38837
I20260811 18:58:10.280113 19390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: NON_VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: true } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } } }
I20260811 18:58:10.280172 19390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:10.280356 19581 master.cc:537] Master@127.5.226.124:38837 shutting down...
I20260811 18:58:10.280965 19665 raft_consensus.cc:1261] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 1 FOLLOWER]: Refusing update from remote peer 911c5d267bfc4b6e86f00940f1def17a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 18:58:10.281226 19387 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 18:58:10.282274 18242 consensus_peers.cc:487] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a -> Peer db898a8a682046afac193ba713c7d0fd (127.5.226.124:38837): Couldn't send request to peer db898a8a682046afac193ba713c7d0fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 18:58:10.282536 19384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.279227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45205 (local address 127.0.0.1:53658)
0811 18:58:10.279406 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.279416 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.279462 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.279627 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.279628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.279630 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:10.279666 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.279667 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.280459 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.280460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.281573 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.281576 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.282293 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.282295 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.282355 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.282378 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.282440 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.282478 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163}
I20260811 18:58:10.282565 19577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.279324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53658 (local address 127.5.226.125:45205)
0811 18:58:10.279365 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.279367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.279462 (+ 95us) server_negotiation.cc:407] Connection header received
0811 18:58:10.279509 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.279510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.279534 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.279600 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:10.279723 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.280385 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.281685 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.282214 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.282284 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.282370 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.282460 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.282504 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:58:10.282821 19503 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 LEARNER]: Refusing update from remote peer 911c5d267bfc4b6e86f00940f1def17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 18:58:10.282994 19387 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: NON_VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 18:58:10.283449 19581 raft_consensus.cc:2229] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:10.283541 19581 raft_consensus.cc:2258] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:10.283592 19581 tablet_replica.cc:330] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: stopping tablet replica
I20260811 18:58:10.283581 19503 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER db898a8a682046afac193ba713c7d0fd (127.5.226.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: NON_VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: true } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } } }
I20260811 18:58:10.284647 19770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: NON_VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: true } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } } }
I20260811 18:58:10.284741 19770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: This master's current role is: LEARNER
I20260811 18:58:10.284862 19556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 911c5d267bfc4b6e86f00940f1def17a. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: NON_VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: true } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } } }
I20260811 18:58:10.284910 19556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: This master's current role is: LEARNER
I20260811 18:58:10.285066 19387 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a: attempting to promote NON_VOTER 07b619355bda44889924c86231d34c3b to VOTER
I20260811 18:58:10.285241 19387 consensus_queue.cc:237] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } }
I20260811 18:58:10.285729 19503 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 LEARNER]: Refusing update from remote peer 911c5d267bfc4b6e86f00940f1def17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 18:58:10.285871 19390 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260811 18:58:10.285957 18242 consensus_peers.cc:487] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a -> Peer db898a8a682046afac193ba713c7d0fd (127.5.226.124:38837): Couldn't send request to peer db898a8a682046afac193ba713c7d0fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 18:58:10.286444 19774 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 07b619355bda44889924c86231d34c3b (127.5.226.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } } }
I20260811 18:58:10.286665 19503 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 07b619355bda44889924c86231d34c3b (127.5.226.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } } }
I20260811 18:58:10.287111 19774 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } } }
I20260811 18:58:10.287137 19390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } } }
I20260811 18:58:10.287184 19774 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:10.287187 19390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:10.287477 19556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } } }
I20260811 18:58:10.287552 19556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:58:10.305962 19581 master.cc:552] Master@127.5.226.124:38837 shutdown complete.
I20260811 18:58:10.306028 19581 master_runner.cc:305] Clearing existing system tablet
I20260811 18:58:10.306155 19581 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:10.306201 19581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:10.306915 19581 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:10.307477 19777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.307668 19581 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:10.307731 19581 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:58:10.307755 19581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/wal
uuid: "db898a8a682046afac193ba713c7d0fd"
format_stamp: "Formatted at 2026-08-11 18:58:10 on dist-test-slave-gjw7"
server_key: "13b88a1426fedba81e9810951037aeb4"
server_key_iv: "20935910f16674bfa0a6f40a95e0d1d8"
server_key_version: "encryptionkey@0"
I20260811 18:58:10.308578 19581 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:10.310045 19581 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 18:58:10.310117 19581 log.cc:1196] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 18:58:10.310290 19581 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: Deleting consensus metadata
I20260811 18:58:10.310523 19581 master_runner.cc:315] Copying system tablet from 127.5.226.126:40251
I20260811 18:58:10.311147 19581 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: tablet copy: Beginning tablet copy session from remote peer at address 127.5.226.126:40251
I20260811 18:58:10.317474 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.311524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34916 (local address 127.5.226.126:40251)
0811 18:58:10.311578 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.311580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.311696 (+ 116us) server_negotiation.cc:407] Connection header received
0811 18:58:10.311756 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.311756 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.311767 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.311813 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.312187 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.312689 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.313757 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.313961 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.314023 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.315018 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.315020 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.315020 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.315027 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.316432 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.316795 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.316796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.316796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.316843 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.317017 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.317018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.317018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.317118 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.317163 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.317349 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.317410 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 18:58:10.317721 19788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.311440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:34916)
0811 18:58:10.311609 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.311620 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.311693 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.311820 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.311821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.312032 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.312113 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.312115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.312757 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.312758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.313667 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.313671 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.314032 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.314033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.314104 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.314530 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.314536 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.314930 (+ 394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.316509 (+ 1579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.316510 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.316511 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.316730 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.316901 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.316902 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.316902 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.316964 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.317168 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.317169 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.317214 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.317278 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.317445 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":70,"threads_started":1}
I20260811 18:58:10.317965 18315 tablet_copy_service.cc:140] P 911c5d267bfc4b6e86f00940f1def17a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer db898a8a682046afac193ba713c7d0fd ({username='oryx', principal='oryx/127.5.226.124@KRBTEST.COM'} at 127.0.0.1:34916)
I20260811 18:58:10.318029 18315 tablet_copy_service.cc:161] P 911c5d267bfc4b6e86f00940f1def17a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer db898a8a682046afac193ba713c7d0fd at {username='oryx', principal='oryx/127.5.226.124@KRBTEST.COM'} at 127.0.0.1:34916: session id = db898a8a682046afac193ba713c7d0fd-00000000000000000000000000000000
I20260811 18:58:10.318624 18315 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 18:58:10.319096 19581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 18:58:10.319995 19581 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: tablet copy: Starting download of 0 data blocks...
I20260811 18:58:10.320127 19581 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: tablet copy: Starting download of 1 WAL segments...
I20260811 18:58:10.320889 19581 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 18:58:10.321683 18315 tablet_copy_service.cc:342] P 911c5d267bfc4b6e86f00940f1def17a: Request end of tablet copy session db898a8a682046afac193ba713c7d0fd-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.5.226.124@KRBTEST.COM'} at 127.0.0.1:34916
I20260811 18:58:10.321744 18315 tablet_copy_service.cc:433] P 911c5d267bfc4b6e86f00940f1def17a: ending tablet copy session db898a8a682046afac193ba713c7d0fd-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer db898a8a682046afac193ba713c7d0fd
I20260811 18:58:10.323824 19581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:10.324944 19796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:10.324991 19789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:10.325176 19581 server_base.cc:1034] running on GCE node
W20260811 18:58:10.325407 19790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:10.325567 19581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:10.325701 19581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:10.326833 19581 hybrid_clock.cc:648] HybridClock initialized: now 1786474690326825 us; error 26 us; skew 500 ppm
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:10.328164 19581 init.cc:377] Logged in from keytab as oryx/127.5.226.124@KRBTEST.COM (short username oryx)
I20260811 18:58:10.328450 19581 webserver.cc:460] Webserver started at http://127.5.226.124:45429/ using document root <none> and password file <none>
I20260811 18:58:10.328564 19581 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:10.328600 19581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:10.329348 19581 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:10.329906 19804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.330049 19581 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:10.330109 19581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/wal
uuid: "db898a8a682046afac193ba713c7d0fd"
format_stamp: "Formatted at 2026-08-11 18:58:10 on dist-test-slave-gjw7"
server_key: "13b88a1426fedba81e9810951037aeb4"
server_key_iv: "20935910f16674bfa0a6f40a95e0d1d8"
server_key_version: "encryptionkey@0"
I20260811 18:58:10.330173 19581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:10.338534 19581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:10.340245 19581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:10.343664 19909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.124:38837 every 8 connection(s)
I20260811 18:58:10.343643 19581 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.124:38837
I20260811 18:58:10.344074 19581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/master-2/data/info.pb
I20260811 18:58:10.344807 19910 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:58:10.345541 19910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: Bootstrap starting.
I20260811 18:58:10.348384 19910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:58:10.348599 19910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: Bootstrap complete.
I20260811 18:58:10.348815 19910 raft_consensus.cc:348] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } }
I20260811 18:58:10.348903 19910 raft_consensus.cc:729] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: db898a8a682046afac193ba713c7d0fd, State: Initialized, Role: LEARNER
I20260811 18:58:10.348950 19910 consensus_queue.cc:260] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } }
I20260811 18:58:10.349140 19910 sys_catalog.cc:564] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:10.350783 19936 catalog_manager.cc:1259] Loaded cluster ID: b5b7aa57c00e4a80aa3997b7706d388c
I20260811 18:58:10.350816 19936 catalog_manager.cc:1552] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: loading cluster ID for follower catalog manager: success
I20260811 18:58:10.351894 19936 catalog_manager.cc:1574] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: acquiring CA information for follower catalog manager: success
I20260811 18:58:10.352264 19936 catalog_manager.cc:1602] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:58:10.352442 19917 sys_catalog.cc:455] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } } }
I20260811 18:58:10.352537 19917 sys_catalog.cc:458] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [sys.catalog]: This master's current role is: LEARNER
I20260811 18:58:10.353210 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.345048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47670 (local address 127.5.226.124:38837)
0811 18:58:10.345204 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.345207 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.345218 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:58:10.345244 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.345244 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.345255 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.345436 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.346102 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.347096 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.348086 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.348397 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.350013 (+ 1616us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.350073 (+ 60us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.350075 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.350075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.350080 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.351789 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.352197 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.352198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.352198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.352260 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.352479 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.352479 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.352480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.352616 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.353033 (+ 417us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.353067 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.353139 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
I20260811 18:58:10.353739 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 18401
I20260811 18:58:10.414606 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:43883
--local_ip_for_outbound_sockets=127.5.226.65
--tserver_master_addrs=127.5.226.126:40251
--webserver_port=45555
--webserver_interface=127.5.226.65
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.65.keytab
--principal=oryx/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:45253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.5.226.126:40251,127.5.226.125:45205
--tserver_master_addrs=127.5.226.126:40251,127.5.226.125:45205,127.5.226.124:38837 with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:10.517866 19938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:10.518067 19938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:10.518090 19938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:10.519222 19938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:10.519263 19938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:10.519289 19938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:58:10.520773 19938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:45253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.65.keytab
--principal=oryx/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:43883
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=45555
--tserver_master_addrs=127.5.226.126:40251,127.5.226.125:45205,127.5.226.124:38837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19938
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:10.520999 19938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:10.521232 19938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:10.526142 19961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:10.526129 19966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:10.526119 19962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:10.526387 19938 server_base.cc:1034] running on GCE node
I20260811 18:58:10.526649 19938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:10.526871 19938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:10.528009 19938 hybrid_clock.cc:648] HybridClock initialized: now 1786474690527999 us; error 32 us; skew 500 ppm
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:10.530544 19938 init.cc:377] Logged in from keytab as oryx/127.5.226.65@KRBTEST.COM (short username oryx)
I20260811 18:58:10.530993 19938 webserver.cc:460] Webserver started at http://127.5.226.65:45555/ using document root <none> and password file <none>
I20260811 18:58:10.531243 19938 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:10.531311 19938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:10.532737 19938 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:10.533423 19976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.533587 19938 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:58:10.533677 19938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "e5de69080e7c484ea4acc681a8f4b27c"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "64d3ce97b8c0c6ef3a1acbe96bb24727"
server_key_iv: "7e1bf18b49c26d767e4ae44787c55372"
server_key_version: "encryptionkey@0"
I20260811 18:58:10.534044 19938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:10.563627 19938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:10.565773 19938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:10.565914 19938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:10.566144 19938 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:10.566460 19938 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:10.566495 19938 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.566524 19938 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:10.566548 19938 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.572623 19938 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:43883
I20260811 18:58:10.572676 20195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:43883 every 8 connection(s)
I20260811 18:58:10.573019 19938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.125@KRBTEST.COM
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:10.581409 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 19938
I20260811 18:58:10.581578 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 18662
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.124@KRBTEST.COM
I20260811 18:58:10.586933 19577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.574195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:40721 (local address 127.5.226.125:45205)
0811 18:58:10.574266 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.574268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.574360 (+ 92us) server_negotiation.cc:407] Connection header received
0811 18:58:10.575282 (+ 922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.575284 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.575299 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.575333 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.576165 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.576915 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.578790 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.578971 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.579023 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.581147 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.581149 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.581149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.581160 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.585446 (+ 4286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.585878 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.585879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.585880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.585955 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.586192 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.586193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.586194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.586377 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.586456 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.586730 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.586824 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 18:58:10.587360 20209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.574082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45205 (local address 127.5.226.65:40721)
0811 18:58:10.574289 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.574299 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.575172 (+ 873us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.575408 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.575409 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.575789 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.576040 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.576047 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.577059 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.577060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.578304 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.578306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.579040 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.579041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.579104 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.579482 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.579486 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.581026 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.585531 (+ 4505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.585540 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.585542 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.585797 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.586020 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.586020 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.586021 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.586131 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.586439 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.586443 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.586583 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.586672 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.586825 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":40,"thread_start_us":61,"threads_started":1}
I20260811 18:58:10.588235 20201 heartbeater.cc:347] Connected to a master server at 127.5.226.125:45205
I20260811 18:58:10.588344 20201 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:10.588573 20201 heartbeater.cc:511] Master 127.5.226.125:45205 requested a full tablet report, sending...
I20260811 18:58:10.589260 19480 ts_manager.cc:194] Registered new tserver with Master: e5de69080e7c484ea4acc681a8f4b27c (127.5.226.65:43883)
I20260811 18:58:10.589911 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.573855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:59239 (local address 127.5.226.126:40251)
0811 18:58:10.573908 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.573910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.574144 (+ 234us) server_negotiation.cc:407] Connection header received
0811 18:58:10.575284 (+ 1140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.575285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.575299 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.575333 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.577015 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.577523 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.578302 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.578565 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.578628 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.581691 (+ 3063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.581692 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.581693 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.581701 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.588438 (+ 6737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.589050 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.589052 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.589052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.589123 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.589327 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.589329 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.589329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.589476 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.589553 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.589757 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.589846 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 18:58:10.589977 20208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.573765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.65:59239)
0811 18:58:10.574035 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.574059 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.575147 (+ 1088us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.575408 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.575409 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.575792 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.576040 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.576047 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.577596 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.577597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.578211 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.578213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.578639 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.578640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.578791 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.579393 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.579405 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.581586 (+ 2181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.588533 (+ 6947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.588534 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.588534 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.588972 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.589183 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.589183 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.589184 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.589250 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.589556 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.589557 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.589618 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.589722 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.589845 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":31,"thread_start_us":107,"threads_started":1}
I20260811 18:58:10.615000 20200 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40251
I20260811 18:58:10.615092 20200 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:10.615182 20200 heartbeater.cc:511] Master 127.5.226.126:40251 requested a full tablet report, sending...
I20260811 18:58:10.615561 18271 ts_manager.cc:194] Re-registered known tserver with Master: e5de69080e7c484ea4acc681a8f4b27c (127.5.226.65:43883)
I20260811 18:58:10.616086 18271 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:59239
I20260811 18:58:10.618046 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.573780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:52141 (local address 127.5.226.124:38837)
0811 18:58:10.573852 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.573855 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.574131 (+ 276us) server_negotiation.cc:407] Connection header received
0811 18:58:10.575245 (+ 1114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.575246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.575259 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.575308 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.576132 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.576927 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.578380 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.578678 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.578736 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.615225 (+ 36489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.615227 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.615228 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.615238 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.616864 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.617346 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.617347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.617348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.617413 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.617600 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.617601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.617601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.617704 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.617751 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.617891 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.617977 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 18:58:10.618116 20205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.573764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:38837 (local address 127.5.226.65:52141)
0811 18:58:10.573955 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.574052 (+ 97us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.575149 (+ 1097us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.575392 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.575395 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.575784 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.576039 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.576045 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.577059 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.577060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.578297 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.578300 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.578747 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.578747 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.578803 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.579699 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.579704 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.615022 (+ 35318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.616963 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.616965 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.616965 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.617213 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.617472 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.617473 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.617473 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.617545 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.617753 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.617755 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.617804 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.617868 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.617996 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":106,"thread_start_us":102,"threads_started":1}
I20260811 18:58:10.618723 20196 heartbeater.cc:347] Connected to a master server at 127.5.226.124:38837
I20260811 18:58:10.618788 20196 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:10.618883 20196 heartbeater.cc:511] Master 127.5.226.124:38837 requested a full tablet report, sending...
I20260811 18:58:10.619297 19840 ts_manager.cc:194] Registered new tserver with Master: e5de69080e7c484ea4acc681a8f4b27c (127.5.226.65:43883)
I20260811 18:58:10.619381 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:42467
--local_ip_for_outbound_sockets=127.5.226.66
--tserver_master_addrs=127.5.226.126:40251
--webserver_port=34839
--webserver_interface=127.5.226.66
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.66.keytab
--principal=oryx/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:45253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.5.226.126:40251,127.5.226.125:45205
--tserver_master_addrs=127.5.226.126:40251,127.5.226.125:45205,127.5.226.124:38837 with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:10.701395 20210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:10.701589 20210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:10.701620 20210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:10.702749 20210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:10.702797 20210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:10.702833 20210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:58:10.704289 20210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:45253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.66.keytab
--principal=oryx/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:42467
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=34839
--tserver_master_addrs=127.5.226.126:40251,127.5.226.125:45205,127.5.226.124:38837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:10.704522 20210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:10.704730 20210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:10.709749 20218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:10.709754 20223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:10.709717 20219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:10.709967 20210 server_base.cc:1034] running on GCE node
I20260811 18:58:10.710165 20210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:10.710412 20210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:10.711549 20210 hybrid_clock.cc:648] HybridClock initialized: now 1786474690711543 us; error 33 us; skew 500 ppm
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:10.713980 20210 init.cc:377] Logged in from keytab as oryx/127.5.226.66@KRBTEST.COM (short username oryx)
I20260811 18:58:10.714434 20210 webserver.cc:460] Webserver started at http://127.5.226.66:34839/ using document root <none> and password file <none>
I20260811 18:58:10.714633 20210 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:10.714692 20210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:10.716037 20210 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:58:10.716578 20244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.716742 20210 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:10.716830 20210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "babe85aa167e43d5862fc6e79a8cd262"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "1a37dd61b93074122a49be74ff4861d4"
server_key_iv: "29a7a9503ab5617cada721f03c58cb6c"
server_key_version: "encryptionkey@0"
I20260811 18:58:10.717152 20210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:10.731817 20210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:10.733673 20210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:10.733789 20210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:10.733986 20210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:10.734262 20210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:10.734294 20210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.734324 20210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:10.734349 20210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.740496 20210 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:42467
I20260811 18:58:10.740533 20469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:42467 every 8 connection(s)
I20260811 18:58:10.740871 20210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 18:58:10.744652 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 20210
I20260811 18:58:10.744819 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 18933
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.124@KRBTEST.COM
I20260811 18:58:10.752003 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.742048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:60805 (local address 127.5.226.124:38837)
0811 18:58:10.742093 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.742095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.742105 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:58:10.743090 (+ 985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.743091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.743104 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.743155 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.743849 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.744609 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.746269 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.746674 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.746723 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.749435 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.749437 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.749437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.749445 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.750744 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.751138 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.751139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.751139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.751189 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.751406 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.751407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.751407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.751517 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.751552 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.751846 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.751922 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 18:58:10.752530 20481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.741587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:38837 (local address 127.5.226.66:60805)
0811 18:58:10.741821 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.741830 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.742836 (+ 1006us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.743171 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.743172 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.743518 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.743732 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.743738 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.744706 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.744707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.746151 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.746154 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.746829 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.746830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.747016 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.747677 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.747690 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.749338 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.750826 (+ 1488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.750833 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.750835 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.751074 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.751241 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.751241 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.751242 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.751353 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.751584 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.751588 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.751729 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.752165 (+ 436us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.752332 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"mutex_wait_us":21,"thread_start_us":99,"threads_started":1}
I20260811 18:58:10.759887 20470 heartbeater.cc:347] Connected to a master server at 127.5.226.124:38837
I20260811 18:58:10.760036 20470 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:10.760319 20470 heartbeater.cc:511] Master 127.5.226.124:38837 requested a full tablet report, sending...
I20260811 18:58:10.760957 19840 ts_manager.cc:194] Registered new tserver with Master: babe85aa167e43d5862fc6e79a8cd262 (127.5.226.66:42467)
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.125@KRBTEST.COM
I20260811 18:58:10.784132 19577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.741974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:44053 (local address 127.5.226.125:45205)
0811 18:58:10.742019 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.742021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.742059 (+ 38us) server_negotiation.cc:407] Connection header received
0811 18:58:10.742967 (+ 908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.742969 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.742980 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.743009 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.743833 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.744639 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.762305 (+ 17666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.762565 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.762603 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.768800 (+ 6197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.768803 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.768803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.768813 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.782543 (+ 13730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.783196 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.783198 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.783199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.783275 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.783555 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.783556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.783557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.783710 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.783800 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.783941 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.784029 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 18:58:10.784147 20482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.741890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45205 (local address 127.5.226.66:44053)
0811 18:58:10.742004 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.742016 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.742853 (+ 837us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.743109 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.743113 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.743512 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.743730 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.743735 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.744722 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.744722 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.762062 (+ 17340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.762067 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.762703 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.762704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.762773 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.767356 (+ 4583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.767362 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.768674 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.782822 (+ 14148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.782824 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.782825 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.783075 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.783355 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.783356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.783357 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.783439 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.783794 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.783795 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.783844 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.783911 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.784034 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":1,"thread_start_us":68,"threads_started":1}
I20260811 18:58:10.784559 20472 heartbeater.cc:347] Connected to a master server at 127.5.226.125:45205
I20260811 18:58:10.784624 20472 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:10.784723 20472 heartbeater.cc:511] Master 127.5.226.125:45205 requested a full tablet report, sending...
I20260811 18:58:10.785072 19480 ts_manager.cc:194] Registered new tserver with Master: babe85aa167e43d5862fc6e79a8cd262 (127.5.226.66:42467)
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:10.786520 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:46209
--local_ip_for_outbound_sockets=127.5.226.67
--tserver_master_addrs=127.5.226.126:40251
--webserver_port=45691
--webserver_interface=127.5.226.67
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.67.keytab
--principal=oryx/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:45253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.5.226.126:40251,127.5.226.125:45205
--tserver_master_addrs=127.5.226.126:40251,127.5.226.125:45205,127.5.226.124:38837 with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:58:10.788266 20480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.741587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.66:35553)
0811 18:58:10.741778 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.741827 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.742842 (+ 1015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.743107 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.743111 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.743522 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.743732 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.743738 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.744484 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.744485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.783036 (+ 38551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.783041 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.783477 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.783479 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.783567 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.784348 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.784353 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.785811 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.787249 (+ 1438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.787250 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.787250 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.787446 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.787651 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.787652 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.787653 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.787719 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.788001 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.788003 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.788050 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.788106 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.788192 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":37549,"thread_start_us":95,"threads_started":1}
I20260811 18:58:10.788319 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.741562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:35553 (local address 127.5.226.126:40251)
0811 18:58:10.741615 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.741616 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.741920 (+ 304us) server_negotiation.cc:407] Connection header received
0811 18:58:10.742961 (+ 1041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.742962 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.742976 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.743029 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.743841 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.744341 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.783131 (+ 38790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.783406 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.783465 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.785879 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.785881 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.785882 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.785891 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.787170 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.787513 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.787514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.787514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.787568 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.787787 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.787788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.787788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.787928 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.787994 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.788148 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.788234 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:58:10.788618 20471 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40251
I20260811 18:58:10.788668 20471 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:10.788730 20471 heartbeater.cc:511] Master 127.5.226.126:40251 requested a full tablet report, sending...
I20260811 18:58:10.789001 18271 ts_manager.cc:194] Re-registered known tserver with Master: babe85aa167e43d5862fc6e79a8cd262 (127.5.226.66:42467)
I20260811 18:58:10.789499 18271 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:35553
W20260811 18:58:10.871138 20484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:10.871357 20484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:10.871381 20484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:10.872560 20484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:10.872601 20484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:10.872627 20484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:58:10.874131 20484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:45253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.67.keytab
--principal=oryx/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:46209
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=45691
--tserver_master_addrs=127.5.226.126:40251,127.5.226.125:45205,127.5.226.124:38837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:10.874336 20484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:10.874519 20484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:10.879489 20493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:10.879489 20498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:10.879817 20484 server_base.cc:1034] running on GCE node
W20260811 18:58:10.879551 20494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:10.880090 20484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:10.880337 20484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:10.881486 20484 hybrid_clock.cc:648] HybridClock initialized: now 1786474690881459 us; error 34 us; skew 500 ppm
I20260811 18:58:10.883811 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.880810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47686 (local address 127.5.226.124:38837)
0811 18:58:10.880864 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.880866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.880875 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:10.880944 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.880945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.880966 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.881016 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:10.881117 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.881775 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.882882 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.883476 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.883559 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.883642 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.883722 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.883757 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 18:58:10.883847 20503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.880719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:38837 (local address 127.0.0.1:47686)
0811 18:58:10.880820 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.880831 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.880892 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.881023 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.881023 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.881025 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:10.881078 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.881080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.881855 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.881855 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.882791 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.882795 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.883586 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.883587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.883655 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.883660 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.883716 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.883768 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"thread_start_us":51,"threads_started":1}
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:10.884243 19860 raft_consensus.cc:1203] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 18:58:10.884346 20484 init.cc:377] Logged in from keytab as oryx/127.5.226.67@KRBTEST.COM (short username oryx)
I20260811 18:58:10.884480 20506 sys_catalog.cc:455] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 911c5d267bfc4b6e86f00940f1def17a. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } } }
I20260811 18:58:10.884624 20506 sys_catalog.cc:458] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [sys.catalog]: This master's current role is: LEARNER
I20260811 18:58:10.884881 20484 webserver.cc:460] Webserver started at http://127.5.226.67:45691/ using document root <none> and password file <none>
I20260811 18:58:10.885108 20484 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:10.885178 20484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:10.886546 20484 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:10.887151 20515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.887307 20484 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:10.887400 20484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "e9b1653b2a2744e58a67f59323c5c143"
format_stamp: "Formatted at 2026-08-11 18:58:09 on dist-test-slave-gjw7"
server_key: "3bbece44e9ce9f989988c1a61b510ea0"
server_key_iv: "703e069d9a05ba55e633086f413844f2"
server_key_version: "encryptionkey@0"
I20260811 18:58:10.887760 20484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:10.900743 20484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:10.902925 20484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:10.903075 20484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:10.903316 20484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:10.903644 20484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:10.903688 20484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.903720 20484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:10.903743 20484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:10.909718 20484 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:46209
I20260811 18:58:10.909777 20745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:46209 every 8 connection(s)
I20260811 18:58:10.910141 20484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:10.912601 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 20484
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.124@KRBTEST.COM
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.125@KRBTEST.COM
Aug 11 18:58:10 dist-test-slave-gjw7 krb5kdc[18175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474690, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:10.923911 19577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.911245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:37719 (local address 127.5.226.125:45205)
0811 18:58:10.911299 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.911300 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.911451 (+ 151us) server_negotiation.cc:407] Connection header received
0811 18:58:10.912347 (+ 896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.912349 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.912359 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.912389 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.913225 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.913923 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.915567 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.915858 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.915915 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.920193 (+ 4278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.920195 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.920195 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.920202 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.922265 (+ 2063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.922829 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.922830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.922831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.922889 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.923179 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.923180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.923180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.923337 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.923380 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.923734 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.923817 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:58:10.924086 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.910856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:55181 (local address 127.5.226.124:38837)
0811 18:58:10.910947 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.910949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.911175 (+ 226us) server_negotiation.cc:407] Connection header received
0811 18:58:10.912315 (+ 1140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.912317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.912330 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.912380 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.913218 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.913923 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.915542 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.915763 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.915820 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.919802 (+ 3982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.919804 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.919804 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.919812 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.922230 (+ 2418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.922825 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.922826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.922827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.922892 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.923167 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.923168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.923168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.923304 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.923361 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.923912 (+ 551us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.923990 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 18:58:10.924587 20757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.910852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:38837 (local address 127.5.226.67:55181)
0811 18:58:10.911060 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.911100 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.912219 (+ 1119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.912471 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.912476 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.912882 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.913101 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.913113 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.914135 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.914136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.915471 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.915474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.915842 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.915843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.915995 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.916527 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.916538 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.919703 (+ 3165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.922308 (+ 2605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.922316 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.922319 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.922734 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.922956 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.922956 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.922957 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.923102 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.923387 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.923395 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.923581 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.923677 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.924330 (+ 653us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":54,"spinlock_wait_cycles":384,"thread_start_us":109,"threads_started":1}
I20260811 18:58:10.924590 20758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.911236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45205 (local address 127.5.226.67:37719)
0811 18:58:10.911375 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.911385 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.912227 (+ 842us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.912471 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.912476 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.912898 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.913101 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.913111 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.914062 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.914063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.915471 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.915474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.915993 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.915994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.916062 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.916646 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.916650 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.920125 (+ 3475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.922356 (+ 2231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.922358 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.922358 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.922735 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.922962 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.922963 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.922963 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.923108 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.923430 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.923431 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.923581 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.924053 (+ 472us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.924402 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":285,"thread_start_us":88,"threads_started":1}
I20260811 18:58:10.925237 20753 heartbeater.cc:347] Connected to a master server at 127.5.226.125:45205
I20260811 18:58:10.925369 20753 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:10.925582 20753 heartbeater.cc:511] Master 127.5.226.125:45205 requested a full tablet report, sending...
I20260811 18:58:10.925711 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.910844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:47633 (local address 127.5.226.126:40251)
0811 18:58:10.910899 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.910901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.911200 (+ 299us) server_negotiation.cc:407] Connection header received
0811 18:58:10.912343 (+ 1143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.912345 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.912360 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.912404 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.914724 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.915455 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.916861 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.917135 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.917208 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.919686 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.919688 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.919688 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.919696 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.923469 (+ 3773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.924840 (+ 1371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.924841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.924842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.924904 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.925113 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.925114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.925114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.925242 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.925317 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.925527 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.925625 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:58:10.925889 20750 heartbeater.cc:347] Connected to a master server at 127.5.226.124:38837
I20260811 18:58:10.925930 20750 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:10.926003 20750 heartbeater.cc:511] Master 127.5.226.124:38837 requested a full tablet report, sending...
I20260811 18:58:10.926077 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.910852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.67:47633)
0811 18:58:10.911061 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.911100 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.912213 (+ 1113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.914411 (+ 2198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.914412 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.914570 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:10.914626 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.914628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.915548 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.915549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.916720 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.916723 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.917227 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.917228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.917317 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.917736 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:10.917742 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:10.919562 (+ 1820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:10.923807 (+ 4245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.923807 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.923808 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.924759 (+ 951us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.924977 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:10.924978 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:10.924978 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:10.925040 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:10.925369 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:10.925369 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:10.925413 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.925799 (+ 386us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.925903 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"spinlock_wait_cycles":384,"thread_start_us":92,"threads_started":1}
I20260811 18:58:10.926198 19480 ts_manager.cc:194] Registered new tserver with Master: e9b1653b2a2744e58a67f59323c5c143 (127.5.226.67:46209)
I20260811 18:58:10.926277 19840 ts_manager.cc:194] Registered new tserver with Master: e9b1653b2a2744e58a67f59323c5c143 (127.5.226.67:46209)
I20260811 18:58:10.926403 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.913812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53672 (local address 127.5.226.125:45205)
0811 18:58:10.913942 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.913944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.916388 (+ 2444us) server_negotiation.cc:407] Connection header received
0811 18:58:10.916442 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.916444 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.916457 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.916496 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.918068 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.918608 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.919415 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.919701 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.919739 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.921425 (+ 1686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.921426 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.921427 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.921434 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.923030 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.925510 (+ 2480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.925511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.925511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.925571 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.925769 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.925771 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.925771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.925903 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.925987 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.926232 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.926320 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260811 18:58:10.926625 20751 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40251
I20260811 18:58:10.926668 20751 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:10.926725 20751 heartbeater.cc:511] Master 127.5.226.126:40251 requested a full tablet report, sending...
I20260811 18:58:10.927175 18271 ts_manager.cc:194] Re-registered known tserver with Master: e9b1653b2a2744e58a67f59323c5c143 (127.5.226.67:46209)
I20260811 18:58:10.927539 18271 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:47633
I20260811 18:58:10.928921 20778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.914158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47696 (local address 127.5.226.124:38837)
0811 18:58:10.914288 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.914290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.916611 (+ 2321us) server_negotiation.cc:407] Connection header received
0811 18:58:10.916635 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.916636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.916647 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.916699 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.921193 (+ 4494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.921999 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.922931 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.923204 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.923255 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.924502 (+ 1247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.924503 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.924503 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.924510 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.927713 (+ 3203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.928013 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.928014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.928015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.928069 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.928459 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.928460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.928460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.928562 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.928645 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.928756 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.928835 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":63,"threads_started":1}
I20260811 18:58:10.929158 20776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.914010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34926 (local address 127.5.226.126:40251)
0811 18:58:10.914402 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.914404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.914412 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:58:10.914438 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.914438 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.914451 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.915253 (+ 802us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:10.915308 (+ 55us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.916358 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.918253 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.918557 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.918617 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.920240 (+ 1623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:10.920241 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:10.920242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:10.920254 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:10.928163 (+ 7909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.928450 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.928451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.928451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.928505 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:10.928687 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:10.928688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:10.928688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:10.928799 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:10.928880 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.928987 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.929074 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":62,"threads_started":1}
I20260811 18:58:10.930706 18271 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:58:10.932204 18271 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:58:10.932902 19387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: NON_VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: true } } }
I20260811 18:58:10.932997 19387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:10.934659 19387 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a: attempting to promote NON_VOTER db898a8a682046afac193ba713c7d0fd to VOTER
I20260811 18:58:10.934800 19387 consensus_queue.cc:237] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } }
I20260811 18:58:10.935177 19860 raft_consensus.cc:1261] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 1 LEARNER]: Refusing update from remote peer 911c5d267bfc4b6e86f00940f1def17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 18:58:10.935338 19503 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 FOLLOWER]: Refusing update from remote peer 911c5d267bfc4b6e86f00940f1def17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 18:58:10.935392 20782 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 18:58:10.935535 20782 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 18:58:10.936154 20785 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, db898a8a682046afac193ba713c7d0fd (127.5.226.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } } }
I20260811 18:58:10.936344 19503 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, db898a8a682046afac193ba713c7d0fd (127.5.226.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } } }
I20260811 18:58:10.936357 19860 raft_consensus.cc:2932] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, db898a8a682046afac193ba713c7d0fd (127.5.226.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } } }
I20260811 18:58:10.937139 20785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } } }
I20260811 18:58:10.937216 20785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:10.937265 20785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } } }
I20260811 18:58:10.937366 20785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:10.937282 20506 sys_catalog.cc:455] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } } }
I20260811 18:58:10.937392 20506 sys_catalog.cc:458] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:58:10.937399 20785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } } }
I20260811 18:58:10.937430 20785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:10.937860 20802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "911c5d267bfc4b6e86f00940f1def17a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } } }
I20260811 18:58:10.937937 20802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:58:10.941960 20503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.938076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:43883 (local address 127.0.0.1:53612)
0811 18:58:10.938310 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.938321 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.938363 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.938791 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.938792 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.938794 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:10.938834 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.938836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.940035 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.940036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.940911 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.940914 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.941728 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.941729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.941791 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.941795 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.941833 (+ 38us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.941881 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":26}
I20260811 18:58:10.942203 20807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.938167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53612 (local address 127.5.226.65:43883)
0811 18:58:10.938632 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.938635 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.938644 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:10.938677 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.938679 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.938692 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.938906 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:10.938971 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.939958 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.940990 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.941646 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.941723 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.941819 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.942070 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.942120 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":106,"threads_started":1}
I20260811 18:58:10.942451 20805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.938161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:46209 (local address 127.0.0.1:46980)
0811 18:58:10.938424 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.938434 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.938485 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.938740 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.938741 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.938743 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:10.938803 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.938805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.939996 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.939997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.941179 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.941182 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.942193 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.942194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.942257 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.942261 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.942323 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.942373 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":40,"thread_start_us":119,"threads_started":1}
I20260811 18:58:10.942641 20811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.938400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46980 (local address 127.5.226.67:46209)
0811 18:58:10.938599 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.938603 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.938613 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:58:10.938645 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.938647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.938660 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.938732 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:10.938854 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.939914 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.941265 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.942017 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.942076 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.942157 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.942542 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.942585 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":91,"threads_started":1}
I20260811 18:58:10.942943 20065 tablet_service.cc:1467] Processing CreateTablet for tablet 012eaa7df7444e75b13f4ad9607bd738 (DEFAULT_TABLE table=test-table [id=90b27b636b77406585fa5f2c63d56980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:10.943269 20065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 012eaa7df7444e75b13f4ad9607bd738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:10.945935 20803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.938167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:42467 (local address 127.0.0.1:42844)
0811 18:58:10.938436 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.938443 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.938475 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.938845 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.938846 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.938848 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:10.938881 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.938883 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.940448 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.940449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.941466 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.941469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.945587 (+ 4118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.945589 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.945667 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.945672 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.945792 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.945844 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":102,"threads_started":1}
I20260811 18:58:10.946185 20808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.938270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42844 (local address 127.5.226.66:42467)
0811 18:58:10.938615 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.938619 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.938631 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:58:10.938673 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.938675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.938690 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.938766 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:10.938955 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.940369 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.941538 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.942437 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.942502 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.942578 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.945818 (+ 3240us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.945877 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":95,"threads_started":1}
I20260811 18:58:10.946156 20609 tablet_service.cc:1467] Processing CreateTablet for tablet 012eaa7df7444e75b13f4ad9607bd738 (DEFAULT_TABLE table=test-table [id=90b27b636b77406585fa5f2c63d56980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:10.946599 20609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 012eaa7df7444e75b13f4ad9607bd738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:10.946617 20812 tablet_bootstrap.cc:492] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c: Bootstrap starting.
I20260811 18:58:10.947196 20812 tablet_bootstrap.cc:654] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:10.947485 20812 log.cc:824] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:10.948210 20812 tablet_bootstrap.cc:492] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c: No bootstrap required, opened a new log
I20260811 18:58:10.948287 20812 ts_tablet_manager.cc:1397] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:58:10.949945 20812 raft_consensus.cc:348] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } } peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } }
I20260811 18:58:10.950098 20812 raft_consensus.cc:374] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:10.950132 20812 raft_consensus.cc:729] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5de69080e7c484ea4acc681a8f4b27c, State: Initialized, Role: FOLLOWER
I20260811 18:58:10.949950 20335 tablet_service.cc:1467] Processing CreateTablet for tablet 012eaa7df7444e75b13f4ad9607bd738 (DEFAULT_TABLE table=test-table [id=90b27b636b77406585fa5f2c63d56980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:10.950281 20812 consensus_queue.cc:260] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } } peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } }
I20260811 18:58:10.950402 20335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 012eaa7df7444e75b13f4ad9607bd738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:10.950505 20816 tablet_bootstrap.cc:492] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143: Bootstrap starting.
I20260811 18:58:10.950558 20812 ts_tablet_manager.cc:1428] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 18:58:10.950671 20200 heartbeater.cc:503] Master 127.5.226.126:40251 was elected leader, sending a full tablet report...
I20260811 18:58:10.951125 20816 tablet_bootstrap.cc:654] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:10.951445 20816 log.cc:824] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:10.952222 20816 tablet_bootstrap.cc:492] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143: No bootstrap required, opened a new log
I20260811 18:58:10.952302 20816 ts_tablet_manager.cc:1397] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:58:10.954125 20819 tablet_bootstrap.cc:492] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262: Bootstrap starting.
I20260811 18:58:10.954294 20816 raft_consensus.cc:348] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } } peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } }
I20260811 18:58:10.954421 20816 raft_consensus.cc:374] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:10.954442 20816 raft_consensus.cc:729] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9b1653b2a2744e58a67f59323c5c143, State: Initialized, Role: FOLLOWER
I20260811 18:58:10.954535 20816 consensus_queue.cc:260] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } } peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } }
I20260811 18:58:10.954794 20819 tablet_bootstrap.cc:654] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:10.954793 20816 ts_tablet_manager.cc:1428] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:58:10.955058 20751 heartbeater.cc:503] Master 127.5.226.126:40251 was elected leader, sending a full tablet report...
I20260811 18:58:10.955152 20819 log.cc:824] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:10.956037 20819 tablet_bootstrap.cc:492] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262: No bootstrap required, opened a new log
I20260811 18:58:10.956094 20819 ts_tablet_manager.cc:1397] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:58:10.957615 20819 raft_consensus.cc:348] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } } peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } }
I20260811 18:58:10.957767 20819 raft_consensus.cc:374] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:10.957801 20819 raft_consensus.cc:729] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: babe85aa167e43d5862fc6e79a8cd262, State: Initialized, Role: FOLLOWER
I20260811 18:58:10.957909 20819 consensus_queue.cc:260] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } } peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } }
I20260811 18:58:10.958129 20819 ts_tablet_manager.cc:1428] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:58:10.958190 20471 heartbeater.cc:503] Master 127.5.226.126:40251 was elected leader, sending a full tablet report...
I20260811 18:58:10.963825 20820 raft_consensus.cc:482] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:10.963914 20820 raft_consensus.cc:504] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } } peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } }
I20260811 18:58:10.964178 20820 leader_election.cc:288] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5de69080e7c484ea4acc681a8f4b27c (127.5.226.65:43883), babe85aa167e43d5862fc6e79a8cd262 (127.5.226.66:42467)
I20260811 18:58:10.966812 20807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.964408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:49627 (local address 127.5.226.65:43883)
0811 18:58:10.964453 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.964455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.964464 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:10.964492 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.964493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.964503 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.964555 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:10.964707 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.965187 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.966160 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.966511 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.966573 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.966582 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.966704 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.966738 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:58:10.966828 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.964334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:43883 (local address 127.5.226.67:49627)
0811 18:58:10.964384 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.964396 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.964437 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.964577 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.964578 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.964580 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:10.964649 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.964651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.965254 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.965255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.966077 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.966079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.966575 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.966576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.966647 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.966650 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.966693 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.966733 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":27}
I20260811 18:58:10.966856 20808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.964483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:42813 (local address 127.5.226.66:42467)
0811 18:58:10.964528 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.964530 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.964537 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:58:10.964558 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.964559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.964567 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.964610 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:10.964734 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.965190 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.966163 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.966528 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.966590 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.966598 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.966749 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.966796 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:58:10.967072 20757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.964428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:42467 (local address 127.5.226.67:42813)
0811 18:58:10.964467 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:10.964475 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:10.964504 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:10.964618 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:10.964619 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:10.964620 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:10.964682 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.964684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.965258 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.965259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.966081 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:10.966083 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.966596 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.966597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:10.966689 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.966692 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:58:10.966736 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 18:58:10.966775 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":35}
I20260811 18:58:10.967362 20097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "012eaa7df7444e75b13f4ad9607bd738" candidate_uuid: "e9b1653b2a2744e58a67f59323c5c143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5de69080e7c484ea4acc681a8f4b27c" is_pre_election: true
I20260811 18:58:10.967542 20097 raft_consensus.cc:2454] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9b1653b2a2744e58a67f59323c5c143 in term 0.
I20260811 18:58:10.967549 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "012eaa7df7444e75b13f4ad9607bd738" candidate_uuid: "e9b1653b2a2744e58a67f59323c5c143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "babe85aa167e43d5862fc6e79a8cd262" is_pre_election: true
I20260811 18:58:10.967679 20371 raft_consensus.cc:2454] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9b1653b2a2744e58a67f59323c5c143 in term 0.
I20260811 18:58:10.967775 20529 leader_election.cc:302] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5de69080e7c484ea4acc681a8f4b27c, e9b1653b2a2744e58a67f59323c5c143; no voters:
I20260811 18:58:10.967936 20820 raft_consensus.cc:2781] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:58:10.967996 20820 raft_consensus.cc:482] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:10.968012 20820 raft_consensus.cc:3037] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:10.968712 20820 raft_consensus.cc:504] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } } peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } }
I20260811 18:58:10.968835 20820 leader_election.cc:288] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [CANDIDATE]: Term 1 election: Requested vote from peers e5de69080e7c484ea4acc681a8f4b27c (127.5.226.65:43883), babe85aa167e43d5862fc6e79a8cd262 (127.5.226.66:42467)
I20260811 18:58:10.968979 20097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "012eaa7df7444e75b13f4ad9607bd738" candidate_uuid: "e9b1653b2a2744e58a67f59323c5c143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5de69080e7c484ea4acc681a8f4b27c"
I20260811 18:58:10.969019 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "012eaa7df7444e75b13f4ad9607bd738" candidate_uuid: "e9b1653b2a2744e58a67f59323c5c143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "babe85aa167e43d5862fc6e79a8cd262"
I20260811 18:58:10.969063 20097 raft_consensus.cc:3037] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:10.969079 20371 raft_consensus.cc:3037] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:10.969977 20097 raft_consensus.cc:2454] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9b1653b2a2744e58a67f59323c5c143 in term 1.
I20260811 18:58:10.969977 20371 raft_consensus.cc:2454] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9b1653b2a2744e58a67f59323c5c143 in term 1.
I20260811 18:58:10.970140 20529 leader_election.cc:302] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5de69080e7c484ea4acc681a8f4b27c, e9b1653b2a2744e58a67f59323c5c143; no voters:
I20260811 18:58:10.970247 20820 raft_consensus.cc:2781] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:10.970489 20820 raft_consensus.cc:686] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [term 1 LEADER]: Becoming Leader. State: Replica: e9b1653b2a2744e58a67f59323c5c143, State: Running, Role: LEADER
I20260811 18:58:10.970587 20820 consensus_queue.cc:237] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } } peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } }
I20260811 18:58:10.971431 18271 catalog_manager.cc:5495] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9b1653b2a2744e58a67f59323c5c143 (127.5.226.67). New cstate: current_term: 1 leader_uuid: "e9b1653b2a2744e58a67f59323c5c143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } health_report { overall_health: HEALTHY } } }
I20260811 18:58:10.980707 20811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:10.978766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46994 (local address 127.5.226.67:46209)
0811 18:58:10.978815 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:10.978817 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:10.978826 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:10.978860 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:10.978861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:10.978877 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:10.978932 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:10.979015 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.979488 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.980158 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:10.980341 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:10.980381 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:10.980471 (+ 90us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:10.980562 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:10.980614 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:10.980627 (+ 13us) server_negotiation.cc:299] Negotiation successful
0811 18:58:10.980642 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 18:58:10.982746 20371 raft_consensus.cc:1261] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262 [term 1 FOLLOWER]: Refusing update from remote peer e9b1653b2a2744e58a67f59323c5c143: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:10.982743 20097 raft_consensus.cc:1261] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c [term 1 FOLLOWER]: Refusing update from remote peer e9b1653b2a2744e58a67f59323c5c143: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:10.983084 20831 consensus_queue.cc:1035] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [LEADER]: Connected to new peer: Peer: permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:10.983214 20820 consensus_queue.cc:1035] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:10.985525 20835 mvcc.cc:205] Tried to move back new op lower bound from 7317400334262870016 to 7317400334216155136. Current Snapshot: MvccSnapshot[applied={T|T < 7317400334262870016}]
I20260811 18:58:10.988046 20837 mvcc.cc:205] Tried to move back new op lower bound from 7317400334262870016 to 7317400334216155136. Current Snapshot: MvccSnapshot[applied={T|T < 7317400334262870016 or (T in {7317400334262870016})}]
I20260811 18:58:10.988179 20836 mvcc.cc:205] Tried to move back new op lower bound from 7317400334262870016 to 7317400334216155136. Current Snapshot: MvccSnapshot[applied={T|T < 7317400334262870016 or (T in {7317400334262870016})}]
I20260811 18:58:10.988840 18274 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:10.988932 18274 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:10.990235 18274 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 911c5d267bfc4b6e86f00940f1def17a: Sending DeleteTablet for 3 replicas of tablet 012eaa7df7444e75b13f4ad9607bd738
I20260811 18:58:10.990576 20609 tablet_service.cc:1514] Processing DeleteTablet for tablet 012eaa7df7444e75b13f4ad9607bd738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:10 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:46980
I20260811 18:58:10.990929 20065 tablet_service.cc:1514] Processing DeleteTablet for tablet 012eaa7df7444e75b13f4ad9607bd738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:10 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:53612
I20260811 18:58:10.991293 20335 tablet_service.cc:1514] Processing DeleteTablet for tablet 012eaa7df7444e75b13f4ad9607bd738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:10 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:42844
I20260811 18:58:10.991453 20854 tablet_replica.cc:330] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143: stopping tablet replica
I20260811 18:58:10.991662 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 18210
I20260811 18:58:11.004361 20854 raft_consensus.cc:2229] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:58:11.004616 20854 raft_consensus.cc:2258] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:11.004801 20856 tablet_replica.cc:330] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c: stopping tablet replica
I20260811 18:58:11.004966 20856 raft_consensus.cc:2229] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:11.005097 20856 raft_consensus.cc:2258] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:11.006485 20856 ts_tablet_manager.cc:1905] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:11.006603 20854 ts_tablet_manager.cc:1905] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:11.008276 20857 tablet_replica.cc:330] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262: stopping tablet replica
I20260811 18:58:11.008421 20857 raft_consensus.cc:2229] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:11.008544 20857 raft_consensus.cc:2258] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:11.008630 20854 ts_tablet_manager.cc:1918] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:11.008724 20856 ts_tablet_manager.cc:1918] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:11.008802 20856 log.cc:1196] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-0/wal/wals/012eaa7df7444e75b13f4ad9607bd738
I20260811 18:58:11.008805 20854 log.cc:1196] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/012eaa7df7444e75b13f4ad9607bd738
I20260811 18:58:11.009078 20856 ts_tablet_manager.cc:1939] T 012eaa7df7444e75b13f4ad9607bd738 P e5de69080e7c484ea4acc681a8f4b27c: Deleting consensus metadata
I20260811 18:58:11.009253 20854 ts_tablet_manager.cc:1939] T 012eaa7df7444e75b13f4ad9607bd738 P e9b1653b2a2744e58a67f59323c5c143: Deleting consensus metadata
I20260811 18:58:11.010043 20857 ts_tablet_manager.cc:1905] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:11.011575 20857 ts_tablet_manager.cc:1918] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:11.011651 20857 log.cc:1196] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/012eaa7df7444e75b13f4ad9607bd738
I20260811 18:58:11.011899 20857 ts_tablet_manager.cc:1939] T 012eaa7df7444e75b13f4ad9607bd738 P babe85aa167e43d5862fc6e79a8cd262: Deleting consensus metadata
W20260811 18:58:11.012638 20525 connection.cc:535] server connection from 127.0.0.1:46980 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 18:58:11.012629 20249 connection.cc:535] server connection from 127.0.0.1:42844 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 18:58:11.012887 19983 connection.cc:535] server connection from 127.0.0.1:53612 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 18:58:11.021238 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:11.014405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53688 (local address 127.5.226.125:45205)
0811 18:58:11.014463 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:11.014465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:11.014599 (+ 134us) server_negotiation.cc:407] Connection header received
0811 18:58:11.014701 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:11.014703 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:11.014718 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:11.014763 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:11.015346 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:11.015863 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:11.016919 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:11.017125 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:11.017176 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:11.018558 (+ 1382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:11.018560 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:11.018561 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:11.018568 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:11.020017 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:11.020379 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:11.020381 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:11.020381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:11.020445 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:11.020637 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:11.020638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:11.020639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:11.020782 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:11.020882 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:11.021020 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 18:58:11.021124 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 18:58:11.022571 20778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:11.014672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47710 (local address 127.5.226.124:38837)
0811 18:58:11.014717 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:11.014719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:11.014728 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:11.014753 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:11.014754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:11.014765 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:11.014817 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:11.015909 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:11.016656 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:11.018045 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:11.018366 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:11.018456 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:11.019742 (+ 1286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:11.019745 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:11.019745 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:11.019753 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:11.021453 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:11.021856 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:11.021857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:11.021857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:11.021919 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:11.022109 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:11.022110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:11.022110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:11.022215 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:11.022298 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:11.022403 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 18:58:11.022481 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:58:11.987171 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:11.986825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.67:50889)
0811 18:58:11.987005 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:11.987112 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":66,"threads_started":1}
W20260811 18:58:11.987493 20751 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:40251 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
I20260811 18:58:11.988346 20870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:11.988082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.65:44873)
0811 18:58:11.988208 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:11.988297 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":60,"threads_started":1}
W20260811 18:58:11.988559 20200 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:40251 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
I20260811 18:58:11.988732 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:11.988165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.66:48767)
0811 18:58:11.988385 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:11.988689 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":62,"threads_started":1}
W20260811 18:58:11.988911 20471 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:40251 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
I20260811 18:58:12.491099 20873 raft_consensus.cc:482] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 911c5d267bfc4b6e86f00940f1def17a)
I20260811 18:58:12.491340 20873 raft_consensus.cc:504] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } }
I20260811 18:58:12.491660 20873 leader_election.cc:288] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 911c5d267bfc4b6e86f00940f1def17a (127.5.226.126:40251), 07b619355bda44889924c86231d34c3b (127.5.226.125:45205)
I20260811 18:58:12.491792 20875 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 911c5d267bfc4b6e86f00940f1def17a)
I20260811 18:58:12.491910 20875 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } }
I20260811 18:58:12.492041 20880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.491806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:35394)
0811 18:58:12.491919 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:12.491990 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":49,"threads_started":1}
I20260811 18:58:12.492151 20875 leader_election.cc:288] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 911c5d267bfc4b6e86f00940f1def17a (127.5.226.126:40251), db898a8a682046afac193ba713c7d0fd (127.5.226.124:38837)
W20260811 18:58:12.492199 19806 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
I20260811 18:58:12.492663 20883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.492562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:35416)
0811 18:58:12.492604 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:12.492632 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 18:58:12.492766 20895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.492346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:35402)
0811 18:58:12.492672 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:12.492730 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":41,"threads_started":1}
W20260811 18:58:12.492861 19444 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
W20260811 18:58:12.492877 19806 leader_election.cc:334] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 911c5d267bfc4b6e86f00940f1def17a (127.5.226.126:40251): Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
I20260811 18:58:12.493330 20895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.493188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:35418)
0811 18:58:12.493256 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:12.493284 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 18:58:12.493412 19444 leader_election.cc:334] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 911c5d267bfc4b6e86f00940f1def17a (127.5.226.126:40251): Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
I20260811 18:58:12.495139 20884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.491930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53692 (local address 127.5.226.125:45205)
0811 18:58:12.492028 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:12.492030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:12.492371 (+ 341us) server_negotiation.cc:407] Connection header received
0811 18:58:12.492403 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:12.492404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:12.492415 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:12.492473 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:12.492721 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:12.493465 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:12.494415 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:12.494827 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:12.494878 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:12.494888 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:12.495050 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 18:58:12.495076 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75,"thread_start_us":47,"threads_started":1}
I20260811 18:58:12.495151 20880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.491808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45205 (local address 127.0.0.1:53692)
0811 18:58:12.492119 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:12.492129 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:12.492197 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:12.492553 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:12.492555 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:12.492558 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:12.492622 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:12.492624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:12.493544 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:12.493545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:12.494334 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:12.494336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:12.494908 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:12.494910 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:12.494974 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:12.494979 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:58:12.495047 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 18:58:12.495087 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":52,"threads_started":1}
I20260811 18:58:12.495391 19503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db898a8a682046afac193ba713c7d0fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "07b619355bda44889924c86231d34c3b" is_pre_election: true
I20260811 18:58:12.495503 20893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.492316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:38837 (local address 127.0.0.1:47716)
0811 18:58:12.492565 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:12.492574 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:12.492615 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:12.492818 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:12.492819 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:12.492821 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:12.492880 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:12.492882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:12.493746 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:12.493747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:12.494519 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:12.494521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:12.495137 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:12.495138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:12.495197 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:12.495201 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:58:12.495340 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 18:58:12.495383 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":58,"threads_started":1}
I20260811 18:58:12.495530 20896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.492436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47716 (local address 127.5.226.124:38837)
0811 18:58:12.492667 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:12.492668 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:12.492678 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:58:12.492702 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:12.492704 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:12.492713 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:12.492943 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:12.492977 (+ 34us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:12.493674 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:12.494629 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:12.495070 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:12.495127 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:12.495137 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:12.495430 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 18:58:12.495479 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":82,"threads_started":1}
I20260811 18:58:12.495504 19503 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db898a8a682046afac193ba713c7d0fd in term 1.
I20260811 18:58:12.495699 19808 leader_election.cc:302] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07b619355bda44889924c86231d34c3b, db898a8a682046afac193ba713c7d0fd; no voters: 911c5d267bfc4b6e86f00940f1def17a
I20260811 18:58:12.495714 19860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "07b619355bda44889924c86231d34c3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "db898a8a682046afac193ba713c7d0fd" is_pre_election: true
I20260811 18:58:12.495828 19860 raft_consensus.cc:2454] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07b619355bda44889924c86231d34c3b in term 1.
I20260811 18:58:12.495869 20873 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 18:58:12.495920 20873 raft_consensus.cc:482] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 911c5d267bfc4b6e86f00940f1def17a)
I20260811 18:58:12.495949 20873 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:58:12.495986 19450 leader_election.cc:302] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07b619355bda44889924c86231d34c3b, db898a8a682046afac193ba713c7d0fd; no voters: 911c5d267bfc4b6e86f00940f1def17a
I20260811 18:58:12.496081 20875 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 18:58:12.496127 20875 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 911c5d267bfc4b6e86f00940f1def17a)
I20260811 18:58:12.496151 20875 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:58:12.496694 20873 raft_consensus.cc:504] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } }
I20260811 18:58:12.496814 20873 leader_election.cc:288] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [CANDIDATE]: Term 2 election: Requested vote from peers 911c5d267bfc4b6e86f00940f1def17a (127.5.226.126:40251), 07b619355bda44889924c86231d34c3b (127.5.226.125:45205)
I20260811 18:58:12.496805 20875 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } }
I20260811 18:58:12.496937 20875 leader_election.cc:288] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [CANDIDATE]: Term 2 election: Requested vote from peers 911c5d267bfc4b6e86f00940f1def17a (127.5.226.126:40251), db898a8a682046afac193ba713c7d0fd (127.5.226.124:38837)
I20260811 18:58:12.497031 20880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.496906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:35424)
0811 18:58:12.496946 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:12.497010 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 18:58:12.497001 19503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db898a8a682046afac193ba713c7d0fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "07b619355bda44889924c86231d34c3b"
I20260811 18:58:12.497082 19503 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate db898a8a682046afac193ba713c7d0fd in current term 2: Already voted for candidate 07b619355bda44889924c86231d34c3b in this term.
I20260811 18:58:12.497103 19860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "07b619355bda44889924c86231d34c3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "db898a8a682046afac193ba713c7d0fd"
I20260811 18:58:12.497181 20893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.497104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:35428)
0811 18:58:12.497139 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:12.497161 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 18:58:12.497186 19860 raft_consensus.cc:2379] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 07b619355bda44889924c86231d34c3b in current term 2: Already voted for candidate db898a8a682046afac193ba713c7d0fd in this term.
I20260811 18:58:12.497473 20893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.497391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:35430)
0811 18:58:12.497425 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:12.497451 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 18:58:12.497502 20880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.497428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:35446)
0811 18:58:12.497456 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:12.497482 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260811 18:58:12.497548 19806 leader_election.cc:334] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 911c5d267bfc4b6e86f00940f1def17a (127.5.226.126:40251): Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
W20260811 18:58:12.497550 19444 leader_election.cc:334] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 911c5d267bfc4b6e86f00940f1def17a (127.5.226.126:40251): Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
I20260811 18:58:12.497574 19806 leader_election.cc:302] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: db898a8a682046afac193ba713c7d0fd; no voters: 07b619355bda44889924c86231d34c3b, 911c5d267bfc4b6e86f00940f1def17a
I20260811 18:58:12.497617 19444 leader_election.cc:302] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07b619355bda44889924c86231d34c3b; no voters: 911c5d267bfc4b6e86f00940f1def17a, db898a8a682046afac193ba713c7d0fd
I20260811 18:58:12.497681 20875 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 18:58:12.497709 20873 raft_consensus.cc:2726] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 18:58:12.988149 20899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.987931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.67:48201)
0811 18:58:12.988064 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:12.988105 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":71,"threads_started":1}
I20260811 18:58:12.989091 20902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.988889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.65:44375)
0811 18:58:12.989011 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:12.989048 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":78,"threads_started":1}
I20260811 18:58:12.989379 20903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:12.989173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.66:37819)
0811 18:58:12.989280 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:12.989340 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":53,"threads_started":1}
I20260811 18:58:13.989152 20904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:13.988825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.67:41901)
0811 18:58:13.988969 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:13.989018 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
I20260811 18:58:13.989748 20905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:13.989546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.65:59561)
0811 18:58:13.989665 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:13.989705 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":55,"threads_started":1}
I20260811 18:58:13.989984 20906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:13.989733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.66:53485)
0811 18:58:13.989886 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:13.989927 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":51,"threads_started":1}
I20260811 18:58:14.187428 20909 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:14.187518 20909 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } }
I20260811 18:58:14.187680 20909 leader_election.cc:288] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 911c5d267bfc4b6e86f00940f1def17a (127.5.226.126:40251), db898a8a682046afac193ba713c7d0fd (127.5.226.124:38837)
I20260811 18:58:14.187976 20910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.187780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:35702)
0811 18:58:14.187893 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.187933 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":61,"threads_started":1}
I20260811 18:58:14.187930 19860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "07b619355bda44889924c86231d34c3b" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "db898a8a682046afac193ba713c7d0fd" is_pre_election: true
I20260811 18:58:14.188027 19860 raft_consensus.cc:2454] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07b619355bda44889924c86231d34c3b in term 2.
I20260811 18:58:14.188179 19450 leader_election.cc:302] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07b619355bda44889924c86231d34c3b, db898a8a682046afac193ba713c7d0fd; no voters:
I20260811 18:58:14.188282 20909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 18:58:14.188334 20909 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:14.188371 20910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.188264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:35704)
0811 18:58:14.188300 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.188329 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 18:58:14.188373 20909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 2 FOLLOWER]: Advancing to term 3
W20260811 18:58:14.188439 19444 leader_election.cc:334] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 911c5d267bfc4b6e86f00940f1def17a (127.5.226.126:40251): Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
I20260811 18:58:14.189177 20909 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } }
I20260811 18:58:14.189312 20909 leader_election.cc:288] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [CANDIDATE]: Term 3 election: Requested vote from peers 911c5d267bfc4b6e86f00940f1def17a (127.5.226.126:40251), db898a8a682046afac193ba713c7d0fd (127.5.226.124:38837)
I20260811 18:58:14.189482 20910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.189392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:35714)
0811 18:58:14.189436 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.189459 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 18:58:14.189462 19860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "07b619355bda44889924c86231d34c3b" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "db898a8a682046afac193ba713c7d0fd"
I20260811 18:58:14.189536 19860 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 2 FOLLOWER]: Advancing to term 3
I20260811 18:58:14.189806 20910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.189715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:35728)
0811 18:58:14.189758 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.189786 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 18:58:14.189877 19444 leader_election.cc:334] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 911c5d267bfc4b6e86f00940f1def17a (127.5.226.126:40251): Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
I20260811 18:58:14.190320 19860 raft_consensus.cc:2454] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07b619355bda44889924c86231d34c3b in term 3.
I20260811 18:58:14.190465 19450 leader_election.cc:302] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07b619355bda44889924c86231d34c3b, db898a8a682046afac193ba713c7d0fd; no voters: 911c5d267bfc4b6e86f00940f1def17a
I20260811 18:58:14.190544 20909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 3 FOLLOWER]: Leader election won for term 3
I20260811 18:58:14.190644 20909 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [term 3 LEADER]: Becoming Leader. State: Replica: 07b619355bda44889924c86231d34c3b, State: Running, Role: LEADER
I20260811 18:58:14.190716 20909 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } }
I20260811 18:58:14.191035 20915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07b619355bda44889924c86231d34c3b. Latest consensus state: current_term: 3 leader_uuid: "07b619355bda44889924c86231d34c3b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } } }
I20260811 18:58:14.191126 20915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:14.191308 20918 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:14.191815 20918 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:14.191888 20918 catalog_manager.cc:1259] Loaded cluster ID: b5b7aa57c00e4a80aa3997b7706d388c
I20260811 18:58:14.191917 20918 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:14.192099 20918 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:14.192168 20918 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: Loaded TSK: 0
I20260811 18:58:14.192309 20918 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:58:14.264451 19476 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53688:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:58:14.266165 19476 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:58:14.267198 20910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.267090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:35736)
0811 18:58:14.267139 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.267169 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 18:58:14.267216 19860 raft_consensus.cc:1261] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [term 3 FOLLOWER]: Refusing update from remote peer 07b619355bda44889924c86231d34c3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 18:58:14.267617 20910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.267459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.0.0.1:35744)
0811 18:58:14.267534 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.267570 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:58:14.267568 20915 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260811 18:58:14.267709 19444 consensus_peers.cc:487] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b -> Peer 911c5d267bfc4b6e86f00940f1def17a (127.5.226.126:40251): Couldn't send request to peer 911c5d267bfc4b6e86f00940f1def17a. Status: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 18:58:14.268219 20920 sys_catalog.cc:455] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07b619355bda44889924c86231d34c3b. Latest consensus state: current_term: 3 leader_uuid: "07b619355bda44889924c86231d34c3b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } } }
I20260811 18:58:14.268311 20920 sys_catalog.cc:458] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:58:14.268784 20915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "07b619355bda44889924c86231d34c3b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } } }
I20260811 18:58:14.268872 20915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:14.268814 20921 mvcc.cc:205] Tried to move back new op lower bound from 7317400347716431872 to 7317400347405656064. Current Snapshot: MvccSnapshot[applied={T|T < 7317400347716431872}]
I20260811 18:58:14.269037 20920 sys_catalog.cc:455] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "07b619355bda44889924c86231d34c3b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "911c5d267bfc4b6e86f00940f1def17a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40251 } } peers { permanent_uuid: "07b619355bda44889924c86231d34c3b" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45205 } attrs { promote: false } } peers { permanent_uuid: "db898a8a682046afac193ba713c7d0fd" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 38837 } attrs { promote: false } } }
I20260811 18:58:14.269127 20920 sys_catalog.cc:458] T 00000000000000000000000000000000 P db898a8a682046afac193ba713c7d0fd [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:58:14.274098 20910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.270526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:42467 (local address 127.0.0.1:42860)
0811 18:58:14.270556 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.270567 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:14.270613 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:14.271213 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:14.271213 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:14.271214 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:14.271243 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:14.271245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:14.271966 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:14.271967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:14.273082 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:14.273085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:14.273873 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:14.273874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:14.273935 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:14.273940 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:58:14.273994 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 18:58:14.274033 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260811 18:58:14.274125 20945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.270800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42860 (local address 127.5.226.66:42467)
0811 18:58:14.271102 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:14.271104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:14.271111 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:58:14.271138 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:14.271138 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:14.271149 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:14.271212 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:14.271410 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:14.271890 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:14.273154 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:14.273778 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:14.273863 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:14.273879 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:14.274009 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 18:58:14.274056 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":69,"threads_started":1}
I20260811 18:58:14.274266 20940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.270550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:46209 (local address 127.0.0.1:47004)
0811 18:58:14.270719 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.270726 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:14.270764 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:14.271029 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:14.271030 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:14.271033 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:14.271086 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:14.271088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:14.272191 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:14.272192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:14.273220 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:14.273222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:14.273961 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:14.273962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:14.274028 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:14.274032 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:58:14.274074 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 18:58:14.274115 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":76,"threads_started":1}
I20260811 18:58:14.274364 20335 tablet_service.cc:1467] Processing CreateTablet for tablet 248bcbec1ad64edda447db8370c18704 (DEFAULT_TABLE table=test-table [id=a62ae475332447b9a5028e19fce15b45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:14.274509 20335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 248bcbec1ad64edda447db8370c18704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:14.274528 20943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.270797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47004 (local address 127.5.226.67:46209)
0811 18:58:14.270921 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:14.270922 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:14.270928 (+ 6us) server_negotiation.cc:407] Connection header received
0811 18:58:14.270949 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:14.270950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:14.270958 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:14.271010 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:14.271342 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:14.272107 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:14.273327 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:14.273863 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:14.273917 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:14.273928 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:14.274408 (+ 480us) server_negotiation.cc:299] Negotiation successful
0811 18:58:14.274461 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":75,"threads_started":1}
I20260811 18:58:14.274694 20609 tablet_service.cc:1467] Processing CreateTablet for tablet 248bcbec1ad64edda447db8370c18704 (DEFAULT_TABLE table=test-table [id=a62ae475332447b9a5028e19fce15b45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:14.274808 20609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 248bcbec1ad64edda447db8370c18704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:14.275362 20937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.270615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:43883 (local address 127.0.0.1:53616)
0811 18:58:14.270978 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.270988 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:14.271036 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:14.271293 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:14.271294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:14.271295 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:14.271335 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:14.271336 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:14.273279 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:14.273280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:14.274075 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:14.274077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:14.275136 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:14.275137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:14.275196 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:14.275201 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:58:14.275251 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 18:58:14.275289 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":75,"threads_started":1}
I20260811 18:58:14.275388 20946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.270959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53616 (local address 127.5.226.65:43883)
0811 18:58:14.271173 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:14.271175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:14.271182 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:58:14.271208 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:14.271209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:14.271221 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:14.271293 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:14.271385 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:14.272110 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:14.274516 (+ 2406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:14.275033 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:14.275106 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:14.275120 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:14.275264 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 18:58:14.275318 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":72,"threads_started":1}
I20260811 18:58:14.275823 20065 tablet_service.cc:1467] Processing CreateTablet for tablet 248bcbec1ad64edda447db8370c18704 (DEFAULT_TABLE table=test-table [id=a62ae475332447b9a5028e19fce15b45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:14.275925 20951 tablet_bootstrap.cc:492] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262: Bootstrap starting.
I20260811 18:58:14.275957 20065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 248bcbec1ad64edda447db8370c18704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:14.276226 20952 tablet_bootstrap.cc:492] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143: Bootstrap starting.
I20260811 18:58:14.276280 20951 tablet_bootstrap.cc:654] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:14.276595 20952 tablet_bootstrap.cc:654] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:14.276912 20951 tablet_bootstrap.cc:492] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262: No bootstrap required, opened a new log
I20260811 18:58:14.276945 20951 ts_tablet_manager.cc:1397] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:14.277045 20951 raft_consensus.cc:348] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } } peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } }
I20260811 18:58:14.277091 20951 raft_consensus.cc:374] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:14.277102 20951 raft_consensus.cc:729] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: babe85aa167e43d5862fc6e79a8cd262, State: Initialized, Role: FOLLOWER
I20260811 18:58:14.277138 20951 consensus_queue.cc:260] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } } peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } }
I20260811 18:58:14.277323 20951 ts_tablet_manager.cc:1428] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:14.277405 20959 tablet_bootstrap.cc:492] T 248bcbec1ad64edda447db8370c18704 P e5de69080e7c484ea4acc681a8f4b27c: Bootstrap starting.
I20260811 18:58:14.277612 20906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.277515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.66:48271)
0811 18:58:14.277563 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.277588 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 18:58:14.277846 20952 tablet_bootstrap.cc:492] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143: No bootstrap required, opened a new log
I20260811 18:58:14.277879 20906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.277806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.66:48659)
0811 18:58:14.277838 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.277859 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 18:58:14.277894 20952 ts_tablet_manager.cc:1397] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:58:14.277994 20959 tablet_bootstrap.cc:654] T 248bcbec1ad64edda447db8370c18704 P e5de69080e7c484ea4acc681a8f4b27c: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:14.277993 20952 raft_consensus.cc:348] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } } peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } }
I20260811 18:58:14.278052 20952 raft_consensus.cc:374] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:14.278070 20952 raft_consensus.cc:729] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9b1653b2a2744e58a67f59323c5c143, State: Initialized, Role: FOLLOWER
I20260811 18:58:14.278116 20952 consensus_queue.cc:260] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } } peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } }
I20260811 18:58:14.278184 20472 heartbeater.cc:503] Master 127.5.226.125:45205 was elected leader, sending a full tablet report...
I20260811 18:58:14.278296 20952 ts_tablet_manager.cc:1428] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:14.278620 20959 tablet_bootstrap.cc:492] T 248bcbec1ad64edda447db8370c18704 P e5de69080e7c484ea4acc681a8f4b27c: No bootstrap required, opened a new log
I20260811 18:58:14.278661 20959 ts_tablet_manager.cc:1397] T 248bcbec1ad64edda447db8370c18704 P e5de69080e7c484ea4acc681a8f4b27c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:14.278715 20753 heartbeater.cc:503] Master 127.5.226.125:45205 was elected leader, sending a full tablet report...
I20260811 18:58:14.278795 20904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.278693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.67:57871)
0811 18:58:14.278732 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.278756 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 18:58:14.278988 20959 raft_consensus.cc:348] T 248bcbec1ad64edda447db8370c18704 P e5de69080e7c484ea4acc681a8f4b27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } } peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } }
I20260811 18:58:14.279079 20959 raft_consensus.cc:374] T 248bcbec1ad64edda447db8370c18704 P e5de69080e7c484ea4acc681a8f4b27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:14.279106 20959 raft_consensus.cc:729] T 248bcbec1ad64edda447db8370c18704 P e5de69080e7c484ea4acc681a8f4b27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5de69080e7c484ea4acc681a8f4b27c, State: Initialized, Role: FOLLOWER
I20260811 18:58:14.279163 20959 consensus_queue.cc:260] T 248bcbec1ad64edda447db8370c18704 P e5de69080e7c484ea4acc681a8f4b27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } } peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } }
I20260811 18:58:14.279321 20959 ts_tablet_manager.cc:1428] T 248bcbec1ad64edda447db8370c18704 P e5de69080e7c484ea4acc681a8f4b27c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:14.279634 20905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.279530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.65:59795)
0811 18:58:14.279577 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.279608 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 18:58:14.279906 20201 heartbeater.cc:503] Master 127.5.226.125:45205 was elected leader, sending a full tablet report...
I20260811 18:58:14.281374 20962 raft_consensus.cc:482] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:14.281431 20962 raft_consensus.cc:504] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } } peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } }
I20260811 18:58:14.281517 20962 leader_election.cc:288] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers babe85aa167e43d5862fc6e79a8cd262 (127.5.226.66:42467), e5de69080e7c484ea4acc681a8f4b27c (127.5.226.65:43883)
I20260811 18:58:14.281649 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "248bcbec1ad64edda447db8370c18704" candidate_uuid: "e9b1653b2a2744e58a67f59323c5c143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "babe85aa167e43d5862fc6e79a8cd262" is_pre_election: true
I20260811 18:58:14.281672 20097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "248bcbec1ad64edda447db8370c18704" candidate_uuid: "e9b1653b2a2744e58a67f59323c5c143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5de69080e7c484ea4acc681a8f4b27c" is_pre_election: true
I20260811 18:58:14.281718 20371 raft_consensus.cc:2454] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9b1653b2a2744e58a67f59323c5c143 in term 0.
I20260811 18:58:14.281740 20097 raft_consensus.cc:2454] T 248bcbec1ad64edda447db8370c18704 P e5de69080e7c484ea4acc681a8f4b27c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9b1653b2a2744e58a67f59323c5c143 in term 0.
I20260811 18:58:14.281854 20529 leader_election.cc:302] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: babe85aa167e43d5862fc6e79a8cd262, e9b1653b2a2744e58a67f59323c5c143; no voters:
I20260811 18:58:14.281955 20962 raft_consensus.cc:2781] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:58:14.281996 20962 raft_consensus.cc:482] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:14.282012 20962 raft_consensus.cc:3037] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:14.282568 20962 raft_consensus.cc:504] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } } peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } }
I20260811 18:58:14.282680 20962 leader_election.cc:288] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [CANDIDATE]: Term 1 election: Requested vote from peers babe85aa167e43d5862fc6e79a8cd262 (127.5.226.66:42467), e5de69080e7c484ea4acc681a8f4b27c (127.5.226.65:43883)
I20260811 18:58:14.282819 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "248bcbec1ad64edda447db8370c18704" candidate_uuid: "e9b1653b2a2744e58a67f59323c5c143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "babe85aa167e43d5862fc6e79a8cd262"
I20260811 18:58:14.282829 20097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "248bcbec1ad64edda447db8370c18704" candidate_uuid: "e9b1653b2a2744e58a67f59323c5c143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5de69080e7c484ea4acc681a8f4b27c"
I20260811 18:58:14.282892 20097 raft_consensus.cc:3037] T 248bcbec1ad64edda447db8370c18704 P e5de69080e7c484ea4acc681a8f4b27c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:14.282893 20371 raft_consensus.cc:3037] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:14.283385 20097 raft_consensus.cc:2454] T 248bcbec1ad64edda447db8370c18704 P e5de69080e7c484ea4acc681a8f4b27c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9b1653b2a2744e58a67f59323c5c143 in term 1.
I20260811 18:58:14.283396 20371 raft_consensus.cc:2454] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9b1653b2a2744e58a67f59323c5c143 in term 1.
I20260811 18:58:14.283560 20529 leader_election.cc:302] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5de69080e7c484ea4acc681a8f4b27c, e9b1653b2a2744e58a67f59323c5c143; no voters:
I20260811 18:58:14.283644 20962 raft_consensus.cc:2781] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:14.283757 20962 raft_consensus.cc:686] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [term 1 LEADER]: Becoming Leader. State: Replica: e9b1653b2a2744e58a67f59323c5c143, State: Running, Role: LEADER
I20260811 18:58:14.283949 20962 consensus_queue.cc:237] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } } peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } }
I20260811 18:58:14.284005 20904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.283915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.67:47637)
0811 18:58:14.283956 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.283984 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 18:58:14.284534 19480 catalog_manager.cc:5495] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9b1653b2a2744e58a67f59323c5c143 (127.5.226.67). New cstate: current_term: 1 leader_uuid: "e9b1653b2a2744e58a67f59323c5c143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9b1653b2a2744e58a67f59323c5c143" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 46209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260811 18:58:14.290334 20943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.288370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47014 (local address 127.5.226.67:46209)
0811 18:58:14.288410 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:14.288412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:14.288418 (+ 6us) server_negotiation.cc:407] Connection header received
0811 18:58:14.288470 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:14.288470 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:14.288478 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:14.288514 (+ 36us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:14.288616 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:14.289064 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:14.289792 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:14.289978 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:14.290017 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:14.290131 (+ 114us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:14.290155 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:14.290185 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:14.290257 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 18:58:14.290272 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:58:14.291121 20097 raft_consensus.cc:1261] T 248bcbec1ad64edda447db8370c18704 P e5de69080e7c484ea4acc681a8f4b27c [term 1 FOLLOWER]: Refusing update from remote peer e9b1653b2a2744e58a67f59323c5c143: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:14.291148 20371 raft_consensus.cc:1261] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262 [term 1 FOLLOWER]: Refusing update from remote peer e9b1653b2a2744e58a67f59323c5c143: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:14.291378 20966 consensus_queue.cc:1035] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5de69080e7c484ea4acc681a8f4b27c" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:14.291474 20962 consensus_queue.cc:1035] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [LEADER]: Connected to new peer: Peer: permanent_uuid: "babe85aa167e43d5862fc6e79a8cd262" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:14.292116 20906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.292012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.66:52243)
0811 18:58:14.292058 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.292084 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 18:58:14.292146 20905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.292051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.65:53329)
0811 18:58:14.292089 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.292118 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 18:58:14.293087 20906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.293004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.66:55171)
0811 18:58:14.293039 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.293061 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 18:58:14.293087 20904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.292995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.67:34205)
0811 18:58:14.293029 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.293061 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 18:58:14.294396 19480 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53688:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:14.294487 20904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.294405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.67:59297)
0811 18:58:14.294435 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.294461 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 18:58:14.294486 19480 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53688:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:14.294941 20905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.294850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40251 (local address 127.5.226.65:50077)
0811 18:58:14.294892 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.294914 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:40251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 18:58:14.295866 19480 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07b619355bda44889924c86231d34c3b: Sending DeleteTablet for 3 replicas of tablet 248bcbec1ad64edda447db8370c18704
I20260811 18:58:14.296195 20335 tablet_service.cc:1514] Processing DeleteTablet for tablet 248bcbec1ad64edda447db8370c18704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:14 UTC) from {username='oryx', principal='oryx/127.5.226.125@KRBTEST.COM'} at 127.0.0.1:42860
I20260811 18:58:14.296214 20609 tablet_service.cc:1514] Processing DeleteTablet for tablet 248bcbec1ad64edda447db8370c18704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:14 UTC) from {username='oryx', principal='oryx/127.5.226.125@KRBTEST.COM'} at 127.0.0.1:47004
I20260811 18:58:14.296406 20990 tablet_replica.cc:330] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262: stopping tablet replica
I20260811 18:58:14.296407 20065 tablet_service.cc:1514] Processing DeleteTablet for tablet 248bcbec1ad64edda447db8370c18704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:14 UTC) from {username='oryx', principal='oryx/127.5.226.125@KRBTEST.COM'} at 127.0.0.1:53616
I20260811 18:58:14.296468 20990 raft_consensus.cc:2229] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:14.296509 20990 raft_consensus.cc:2258] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:14.296629 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 19938
I20260811 18:58:14.296892 20992 tablet_replica.cc:330] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143: stopping tablet replica
I20260811 18:58:14.297207 20992 raft_consensus.cc:2229] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:58:14.297266 20992 raft_consensus.cc:2258] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:14.304574 20992 ts_tablet_manager.cc:1905] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:14.307727 20992 ts_tablet_manager.cc:1918] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:14.307789 20992 log.cc:1196] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/248bcbec1ad64edda447db8370c18704
I20260811 18:58:14.308001 20992 ts_tablet_manager.cc:1939] T 248bcbec1ad64edda447db8370c18704 P e9b1653b2a2744e58a67f59323c5c143: Deleting consensus metadata
I20260811 18:58:14.308326 19444 catalog_manager.cc:4841] TS e9b1653b2a2744e58a67f59323c5c143 (127.5.226.67:46209): tablet 248bcbec1ad64edda447db8370c18704 (table test-table [id=a62ae475332447b9a5028e19fce15b45]) successfully deleted
I20260811 18:58:14.313311 20990 ts_tablet_manager.cc:1905] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:14.314755 20990 ts_tablet_manager.cc:1918] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:14.314805 20990 log.cc:1196] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/248bcbec1ad64edda447db8370c18704
I20260811 18:58:14.314975 20990 ts_tablet_manager.cc:1939] T 248bcbec1ad64edda447db8370c18704 P babe85aa167e43d5862fc6e79a8cd262: Deleting consensus metadata
I20260811 18:58:14.315313 19450 catalog_manager.cc:4841] TS babe85aa167e43d5862fc6e79a8cd262 (127.5.226.66:42467): tablet 248bcbec1ad64edda447db8370c18704 (table test-table [id=a62ae475332447b9a5028e19fce15b45]) successfully deleted
I20260811 18:58:14.321409 20937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:14.321247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:43883 (local address 127.0.0.1:53630)
0811 18:58:14.321330 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:14.321365 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:43883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 18:58:14.321506 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 20210
W20260811 18:58:14.321599 19450 catalog_manager.cc:4584] TS e5de69080e7c484ea4acc681a8f4b27c (127.5.226.65:43883): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 248bcbec1ad64edda447db8370c18704: Network error: Client connection negotiation failed: client connection to 127.5.226.65:43883: connect: Connection refused (error 111)
I20260811 18:58:14.340711 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 20484
I20260811 18:58:14.359732 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 19198
I20260811 18:58:14.369416 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 19581
2026-08-11T18:58:14Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6582 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:58:14 dist-test-slave-gjw7 krb5kdc[20997](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:58:14 dist-test-slave-gjw7 krb5kdc[20997](info): set up 2 sockets
Aug 11 18:58:14 dist-test-slave-gjw7 krb5kdc[20997](info): commencing operation
krb5kdc: starting...
W20260811 18:58:15.590384 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:58:15 dist-test-slave-gjw7 krb5kdc[20997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:58:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:15Z Disabled control of system clock
WARNING: no policy specified for oryx/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.126.keytab.
Entry for principal oryx/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.126.keytab.
I20260811 18:58:15.714314 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:33873
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.126.keytab
--principal=oryx/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:35721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:33873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:15.795925 21022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:15.796133 21022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:15.796154 21022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:15.797333 21022 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:15.797375 21022 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 18:58:15.797387 21022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:15.797400 21022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:15.797423 21022 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:15.797447 21022 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:15.799027 21022 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:35721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:33873
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.126.keytab
--principal=oryx/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:33873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:15.799265 21022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:15.799486 21022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:15.804225 21029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:15.804349 21022 server_base.cc:1034] running on GCE node
W20260811 18:58:15.804241 21034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:15.804225 21031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:15.804793 21022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:15.805086 21022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:15.806270 21022 hybrid_clock.cc:648] HybridClock initialized: now 1786474695806242 us; error 44 us; skew 500 ppm
Aug 11 18:58:15 dist-test-slave-gjw7 krb5kdc[20997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474695, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:15.808917 21022 init.cc:377] Logged in from keytab as oryx/127.5.226.126@KRBTEST.COM (short username oryx)
I20260811 18:58:15.809504 21022 webserver.cc:460] Webserver started at http://127.5.226.126:39501/ using document root <none> and password file <none>
I20260811 18:58:15.809762 21022 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:15.809815 21022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:15.809950 21022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:15.811064 21022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "d7db3547b9ea475a818a1af1b3ccfa0f"
format_stamp: "Formatted at 2026-08-11 18:58:15 on dist-test-slave-gjw7"
server_key: "74770700bb1f89b74ff840cfb8c9691f"
server_key_iv: "90f33536996aca57edf534c794d78207"
server_key_version: "encryptionkey@0"
I20260811 18:58:15.811424 21022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "d7db3547b9ea475a818a1af1b3ccfa0f"
format_stamp: "Formatted at 2026-08-11 18:58:15 on dist-test-slave-gjw7"
server_key: "74770700bb1f89b74ff840cfb8c9691f"
server_key_iv: "90f33536996aca57edf534c794d78207"
server_key_version: "encryptionkey@0"
I20260811 18:58:15.812743 21022 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:58:15.813434 21051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:15.813596 21022 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:15.813686 21022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "d7db3547b9ea475a818a1af1b3ccfa0f"
format_stamp: "Formatted at 2026-08-11 18:58:15 on dist-test-slave-gjw7"
server_key: "74770700bb1f89b74ff840cfb8c9691f"
server_key_iv: "90f33536996aca57edf534c794d78207"
server_key_version: "encryptionkey@0"
I20260811 18:58:15.813747 21022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:15.827913 21022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:15.830255 21022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:15.830410 21022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:15.835256 21022 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:33873
I20260811 18:58:15.835311 21167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:33873 every 8 connection(s)
I20260811 18:58:15.835659 21022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:15.836361 21168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:15.838836 21168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f: Bootstrap starting.
I20260811 18:58:15.839483 21168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:15.839802 21168 log.cc:824] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:15.839854 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 21022
I20260811 18:58:15.839928 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:58:15.840116 6025 external_mini_cluster.cc:1428] Setting key 5e5d2d2a9135a39d65d26ae592e34335
I20260811 18:58:15.840565 21168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f: No bootstrap required, opened a new log
I20260811 18:58:15.843266 21168 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7db3547b9ea475a818a1af1b3ccfa0f" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33873 } }
I20260811 18:58:15.843448 21168 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:15.843482 21168 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7db3547b9ea475a818a1af1b3ccfa0f, State: Initialized, Role: FOLLOWER
I20260811 18:58:15.843606 21168 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7db3547b9ea475a818a1af1b3ccfa0f" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33873 } }
I20260811 18:58:15.843673 21168 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:15.843708 21168 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:15.843758 21168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:15.844363 21168 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7db3547b9ea475a818a1af1b3ccfa0f" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33873 } }
I20260811 18:58:15.844455 21168 leader_election.cc:302] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7db3547b9ea475a818a1af1b3ccfa0f; no voters:
I20260811 18:58:15.844614 21168 leader_election.cc:288] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:15.844653 21174 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:15.844791 21174 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [term 1 LEADER]: Becoming Leader. State: Replica: d7db3547b9ea475a818a1af1b3ccfa0f, State: Running, Role: LEADER
I20260811 18:58:15.844890 21168 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:15.844878 21174 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7db3547b9ea475a818a1af1b3ccfa0f" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33873 } }
I20260811 18:58:15.845214 21177 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7db3547b9ea475a818a1af1b3ccfa0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7db3547b9ea475a818a1af1b3ccfa0f" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33873 } } }
I20260811 18:58:15.845338 21177 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:15.845202 21174 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7db3547b9ea475a818a1af1b3ccfa0f. Latest consensus state: current_term: 1 leader_uuid: "d7db3547b9ea475a818a1af1b3ccfa0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7db3547b9ea475a818a1af1b3ccfa0f" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33873 } } }
I20260811 18:58:15.845525 21174 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:15.845642 21184 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:15.846359 21184 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 18:58:15 dist-test-slave-gjw7 krb5kdc[20997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:15.848214 21184 catalog_manager.cc:1347] Generated new cluster ID: 3b39baee03264ab59066dfd529f88e4d
I20260811 18:58:15.848273 21184 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:15.852185 21173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:15.840660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37478 (local address 127.5.226.126:33873)
0811 18:58:15.840839 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:15.840849 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:15.840883 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:58:15.841867 (+ 984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:15.841878 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:15.841945 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:15.842106 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:15.842648 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:15.843983 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:15.844871 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:15.845571 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:15.845656 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:15.848614 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:15.848618 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:15.848619 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:15.848632 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:15.850589 (+ 1957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:15.850965 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:15.850969 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:15.850970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:15.851078 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:15.851248 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:15.851249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:15.851249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:15.851564 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:15.851732 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:15.851827 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 18:58:15.851972 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":79,"threads_started":1}
I20260811 18:58:15.876420 21184 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:15.877012 21184 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:15.889472 21184 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f: Generated new TSK 0
I20260811 18:58:15.889721 21184 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.65.keytab.
Entry for principal oryx/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.65.keytab.
I20260811 18:58:15.922359 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33873
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.65.keytab
--principal=oryx/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:35721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:16.030798 21207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:16.031008 21207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:16.031034 21207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:16.032140 21207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:16.032186 21207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:16.032208 21207 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:58:16.032226 21207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:58:16.033728 21207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:35721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.65.keytab
--principal=oryx/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.226.126:33873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:16.033917 21207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:16.034098 21207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:16.038985 21224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:16.039016 21218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:16.039124 21207 server_base.cc:1034] running on GCE node
W20260811 18:58:16.038987 21219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:16.039358 21207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:16.039575 21207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:16.040725 21207 hybrid_clock.cc:648] HybridClock initialized: now 1786474696040712 us; error 27 us; skew 500 ppm
Aug 11 18:58:16 dist-test-slave-gjw7 krb5kdc[20997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474696, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:16.043287 21207 init.cc:377] Logged in from keytab as oryx/127.5.226.65@KRBTEST.COM (short username oryx)
I20260811 18:58:16.043707 21207 webserver.cc:460] Webserver started at http://127.5.226.65:45751/ using document root <none> and password file <none>
I20260811 18:58:16.043903 21207 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:16.043946 21207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:16.044057 21207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:16.045169 21207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "ef460c8798a74a25b3e39691aea0a73b"
format_stamp: "Formatted at 2026-08-11 18:58:16 on dist-test-slave-gjw7"
server_key: "2a8a7ed2201adcf55911214dde967073"
server_key_iv: "668b618662c2f1a3c815433c21804af0"
server_key_version: "encryptionkey@0"
I20260811 18:58:16.045588 21207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "ef460c8798a74a25b3e39691aea0a73b"
format_stamp: "Formatted at 2026-08-11 18:58:16 on dist-test-slave-gjw7"
server_key: "2a8a7ed2201adcf55911214dde967073"
server_key_iv: "668b618662c2f1a3c815433c21804af0"
server_key_version: "encryptionkey@0"
I20260811 18:58:16.046947 21207 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:16.047708 21241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:16.047880 21207 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:16.047967 21207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "ef460c8798a74a25b3e39691aea0a73b"
format_stamp: "Formatted at 2026-08-11 18:58:16 on dist-test-slave-gjw7"
server_key: "2a8a7ed2201adcf55911214dde967073"
server_key_iv: "668b618662c2f1a3c815433c21804af0"
server_key_version: "encryptionkey@0"
I20260811 18:58:16.048022 21207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:16.074819 21207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:16.076890 21207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:16.077008 21207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:16.077586 21207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:16.077629 21207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:16.077653 21207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:16.077664 21207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:16.084167 21207 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:34139
I20260811 18:58:16.084241 21458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:34139 every 8 connection(s)
Aug 11 18:58:16 dist-test-slave-gjw7 krb5kdc[20997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474696, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:16.084589 21207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 18:58:16.087534 21173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.078048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:39847 (local address 127.5.226.126:33873)
0811 18:58:16.078117 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.078119 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.078325 (+ 206us) server_negotiation.cc:407] Connection header received
0811 18:58:16.078910 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.078912 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.078926 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.079007 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:16.079874 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.080656 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.082174 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.082482 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.082562 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.085174 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:16.085176 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:16.085177 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:16.085185 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:16.086426 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.086797 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.086797 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.086798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.086846 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.087008 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.087008 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.087008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.087105 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:16.087149 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:16.087393 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 18:58:16.087467 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 18:58:16.087716 21258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.078012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33873 (local address 127.5.226.65:39847)
0811 18:58:16.078187 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:16.078232 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:16.078794 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:16.079075 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:16.079080 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:16.079454 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:16.079767 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.079774 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.080737 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.080738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.082079 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.082084 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.082568 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.082568 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.082677 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.083232 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:16.083244 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:16.085062 (+ 1818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:16.086495 (+ 1433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:16.086503 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:16.086505 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:16.086731 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:16.086881 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:16.086881 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:16.086882 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:16.086969 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:16.087147 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:16.087150 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:16.087289 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 18:58:16.087377 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 18:58:16.087507 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
I20260811 18:58:16.088178 21460 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33873
I20260811 18:58:16.088263 21460 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:16.088459 21460 heartbeater.cc:511] Master 127.5.226.126:33873 requested a full tablet report, sending...
I20260811 18:58:16.088876 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 21207
I20260811 18:58:16.088960 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:58:16.089164 6025 external_mini_cluster.cc:1428] Setting key 00a054f80a30f6df733b0b67f4bc5a59
I20260811 18:58:16.089356 21088 ts_manager.cc:194] Registered new tserver with Master: ef460c8798a74a25b3e39691aea0a73b (127.5.226.65:34139)
I20260811 18:58:16.090245 21088 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:39847
I20260811 18:58:16.096205 21470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.089165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33873 (local address 127.5.226.65:51449)
0811 18:58:16.089339 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:16.089351 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:16.089409 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:16.089541 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:16.089541 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:16.089729 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:16.089811 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.089813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.090594 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.090595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.091382 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.091386 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.091884 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.091884 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.091962 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.092444 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:16.092449 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:16.092824 (+ 375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:16.094955 (+ 2131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:16.094956 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:16.094957 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:16.095163 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:16.095435 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:16.095436 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:16.095436 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:16.095507 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:16.095824 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:16.095825 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:16.095885 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 18:58:16.095994 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 18:58:16.096095 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":89,"threads_started":1}
I20260811 18:58:16.096222 21173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.089221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:51449 (local address 127.5.226.126:33873)
0811 18:58:16.089352 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.089354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.089394 (+ 40us) server_negotiation.cc:407] Connection header received
0811 18:58:16.089483 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.089484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.089494 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.089538 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:16.089901 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.090480 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.091497 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.091800 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.091868 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.092928 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:16.092930 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:16.092931 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:16.092939 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:16.094831 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.095244 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.095246 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.095247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.095322 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.095573 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.095574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.095574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.095727 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:16.095827 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:16.096042 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 18:58:16.096131 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
WARNING: no policy specified for oryx/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.66.keytab.
Entry for principal oryx/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.66.keytab.
I20260811 18:58:16.118077 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33873
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.66.keytab
--principal=oryx/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:35721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:16.200012 21473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:16.200217 21473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:16.200239 21473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:16.201414 21473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:16.201457 21473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:16.201476 21473 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:58:16.201493 21473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:58:16.202996 21473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:35721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.66.keytab
--principal=oryx/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.226.126:33873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:16.203218 21473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:16.203433 21473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:16.208428 21485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:16.208420 21487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:16.208423 21481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:16.208644 21473 server_base.cc:1034] running on GCE node
I20260811 18:58:16.208832 21473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:16.209034 21473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:16.210201 21473 hybrid_clock.cc:648] HybridClock initialized: now 1786474696210188 us; error 51 us; skew 500 ppm
Aug 11 18:58:16 dist-test-slave-gjw7 krb5kdc[20997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474696, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:16.212697 21473 init.cc:377] Logged in from keytab as oryx/127.5.226.66@KRBTEST.COM (short username oryx)
I20260811 18:58:16.213157 21473 webserver.cc:460] Webserver started at http://127.5.226.66:36801/ using document root <none> and password file <none>
I20260811 18:58:16.213395 21473 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:16.213447 21473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:16.213577 21473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:16.214627 21473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "a6a5df1a57e344aba28d86bb3f278122"
format_stamp: "Formatted at 2026-08-11 18:58:16 on dist-test-slave-gjw7"
server_key: "9d9617b68196a4d8a632502a7eca5d53"
server_key_iv: "978e1ef8782ef1e78a535a82ab0bd239"
server_key_version: "encryptionkey@0"
I20260811 18:58:16.214959 21473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "a6a5df1a57e344aba28d86bb3f278122"
format_stamp: "Formatted at 2026-08-11 18:58:16 on dist-test-slave-gjw7"
server_key: "9d9617b68196a4d8a632502a7eca5d53"
server_key_iv: "978e1ef8782ef1e78a535a82ab0bd239"
server_key_version: "encryptionkey@0"
I20260811 18:58:16.216271 21473 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:58:16.216992 21505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:16.217136 21473 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:16.217226 21473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "a6a5df1a57e344aba28d86bb3f278122"
format_stamp: "Formatted at 2026-08-11 18:58:16 on dist-test-slave-gjw7"
server_key: "9d9617b68196a4d8a632502a7eca5d53"
server_key_iv: "978e1ef8782ef1e78a535a82ab0bd239"
server_key_version: "encryptionkey@0"
I20260811 18:58:16.217332 21473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:16.254045 21473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:16.256238 21473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:16.256383 21473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:16.256947 21473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:16.256990 21473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:16.257021 21473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:16.257045 21473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:58:16 dist-test-slave-gjw7 krb5kdc[20997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474696, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:16.263949 21473 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:42923
I20260811 18:58:16.264010 21713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:42923 every 8 connection(s)
I20260811 18:58:16.264380 21473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 18:58:16.266224 21173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.257403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:58735 (local address 127.5.226.126:33873)
0811 18:58:16.257468 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.257470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.257652 (+ 182us) server_negotiation.cc:407] Connection header received
0811 18:58:16.258207 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.258208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.258228 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.258315 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:16.258940 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.259686 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.260745 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.260985 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.261046 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.263583 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:16.263585 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:16.263585 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:16.263594 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:16.265118 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.265517 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.265517 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.265518 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.265569 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.265746 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.265746 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.265746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.265856 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:16.265898 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:16.266102 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 18:58:16.266161 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 18:58:16.266427 21521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.257377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33873 (local address 127.5.226.66:58735)
0811 18:58:16.257526 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:16.257568 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:16.258101 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:16.258398 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:16.258402 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:16.258657 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:16.258860 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.258866 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.259790 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.259791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.260655 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.260658 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.261063 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.261064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.261193 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.261714 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:16.261723 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:16.263487 (+ 1764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:16.265197 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:16.265201 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:16.265203 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:16.265459 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:16.265614 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:16.265615 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:16.265615 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:16.265707 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:16.265896 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:16.265899 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:16.266011 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 18:58:16.266085 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 18:58:16.266207 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":80,"threads_started":1}
I20260811 18:58:16.266860 21714 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33873
I20260811 18:58:16.266948 21714 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:16.267148 21714 heartbeater.cc:511] Master 127.5.226.126:33873 requested a full tablet report, sending...
I20260811 18:58:16.267531 21091 ts_manager.cc:194] Registered new tserver with Master: a6a5df1a57e344aba28d86bb3f278122 (127.5.226.66:42923)
I20260811 18:58:16.267977 21091 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:58735
I20260811 18:58:16.272681 21173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.268000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:53131 (local address 127.5.226.126:33873)
0811 18:58:16.268046 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.268047 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.268113 (+ 66us) server_negotiation.cc:407] Connection header received
0811 18:58:16.268172 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.268172 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.268182 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.268226 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:16.268600 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.269060 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.269750 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.269938 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.269986 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.270728 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:16.270729 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:16.270729 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:16.270735 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:16.271912 (+ 1177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.272152 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.272153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.272153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.272194 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.272306 (+ 112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.272307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.272307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.272430 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:16.272475 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:16.272566 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 18:58:16.272620 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 18:58:16.272693 21722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.267931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33873 (local address 127.5.226.66:53131)
0811 18:58:16.268058 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:16.268070 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:16.268128 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:16.268230 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:16.268230 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:16.268445 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:16.268522 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.268524 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.269144 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.269144 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.269691 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.269693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.269990 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.269991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.270039 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.270387 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:16.270391 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:16.270664 (+ 273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:16.271971 (+ 1307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:16.271972 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:16.271972 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:16.272111 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:16.272233 (+ 122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:16.272233 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:16.272233 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:16.272276 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:16.272471 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:16.272471 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:16.272504 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 18:58:16.272547 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 18:58:16.272622 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":69,"threads_started":1}
I20260811 18:58:16.274176 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 21473
I20260811 18:58:16.274281 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:58:16.274461 6025 external_mini_cluster.cc:1428] Setting key b7bc3d9cabbc8ef28c187a0054e07779
WARNING: no policy specified for oryx/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.67.keytab.
Entry for principal oryx/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.67.keytab.
I20260811 18:58:16.300563 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33873
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.67.keytab
--principal=oryx/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:35721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:16.384107 21727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:16.384315 21727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:16.384336 21727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:16.385511 21727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:16.385551 21727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:16.385571 21727 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:58:16.385589 21727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:58:16.387118 21727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:35721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.67.keytab
--principal=oryx/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.226.126:33873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:16.387351 21727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:16.387569 21727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:16.392382 21745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:16.392503 21727 server_base.cc:1034] running on GCE node
W20260811 18:58:16.392467 21742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:16.392382 21743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:16.392827 21727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:16.393078 21727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:16.394214 21727 hybrid_clock.cc:648] HybridClock initialized: now 1786474696394203 us; error 30 us; skew 500 ppm
Aug 11 18:58:16 dist-test-slave-gjw7 krb5kdc[20997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474696, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:16.396605 21727 init.cc:377] Logged in from keytab as oryx/127.5.226.67@KRBTEST.COM (short username oryx)
I20260811 18:58:16.397030 21727 webserver.cc:460] Webserver started at http://127.5.226.67:34445/ using document root <none> and password file <none>
I20260811 18:58:16.397215 21727 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:16.397253 21727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:16.397394 21727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:16.398413 21727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5"
format_stamp: "Formatted at 2026-08-11 18:58:16 on dist-test-slave-gjw7"
server_key: "d19a61e48901edcfb5a412f7ac7311c9"
server_key_iv: "9f932b2ddbf32f28c3e15f68180b677d"
server_key_version: "encryptionkey@0"
I20260811 18:58:16.398705 21727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5"
format_stamp: "Formatted at 2026-08-11 18:58:16 on dist-test-slave-gjw7"
server_key: "d19a61e48901edcfb5a412f7ac7311c9"
server_key_iv: "9f932b2ddbf32f28c3e15f68180b677d"
server_key_version: "encryptionkey@0"
I20260811 18:58:16.399914 21727 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:58:16.400584 21759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:16.400749 21727 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:16.400837 21727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5"
format_stamp: "Formatted at 2026-08-11 18:58:16 on dist-test-slave-gjw7"
server_key: "d19a61e48901edcfb5a412f7ac7311c9"
server_key_iv: "9f932b2ddbf32f28c3e15f68180b677d"
server_key_version: "encryptionkey@0"
I20260811 18:58:16.400923 21727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:16.411108 21727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:16.412907 21727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:16.413043 21727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:16.413600 21727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:16.413640 21727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:16.413669 21727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:16.413694 21727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:16.420588 21727 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:42705
I20260811 18:58:16.420755 21986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:42705 every 8 connection(s)
Aug 11 18:58:16 dist-test-slave-gjw7 krb5kdc[20997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474696, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:16.421015 21727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:16.423833 21173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.413998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:37771 (local address 127.5.226.126:33873)
0811 18:58:16.414041 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.414043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.414271 (+ 228us) server_negotiation.cc:407] Connection header received
0811 18:58:16.414812 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.414814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.414827 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.414886 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:16.415769 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.416608 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.418236 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.418666 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.418738 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.421421 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:16.421423 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:16.421423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:16.421431 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:16.422689 (+ 1258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.423062 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.423062 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.423063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.423108 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.423342 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.423343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.423343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.423437 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:16.423481 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:16.423702 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 18:58:16.423761 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:58:16.423987 21787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.414006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33873 (local address 127.5.226.67:37771)
0811 18:58:16.414147 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:16.414182 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:16.414684 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:16.415005 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:16.415010 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:16.415377 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:16.415667 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.415675 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.416701 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.416702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.418098 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.418102 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.418756 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.418758 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.418933 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.419498 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:16.419509 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:16.421311 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:16.422764 (+ 1453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:16.422772 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:16.422775 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:16.422999 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:16.423151 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:16.423152 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:16.423152 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:16.423296 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:16.423485 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:16.423491 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:16.423606 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 18:58:16.423687 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 18:58:16.423816 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":84,"threads_started":1}
I20260811 18:58:16.424444 21987 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33873
I20260811 18:58:16.424532 21987 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:16.424713 21987 heartbeater.cc:511] Master 127.5.226.126:33873 requested a full tablet report, sending...
I20260811 18:58:16.425112 21088 ts_manager.cc:194] Registered new tserver with Master: 9dc94c704ce548dfbb3d3f839fb6e8d5 (127.5.226.67:42705)
I20260811 18:58:16.425604 21088 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:37771
I20260811 18:58:16.425712 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 21727
I20260811 18:58:16.425797 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:58:16.425938 6025 external_mini_cluster.cc:1428] Setting key fbb04bcea32bc7e59f8e38dd86593be3
I20260811 18:58:16.426789 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:58:16.430989 21173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.425523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:55005 (local address 127.5.226.126:33873)
0811 18:58:16.426101 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.426103 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.426110 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:58:16.426129 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.426130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.426139 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.426183 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:16.426590 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.427152 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.427814 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.428066 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.428132 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.428930 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:16.428932 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:16.428932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:16.428939 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:16.430104 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.430429 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.430430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.430430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.430472 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.430623 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.430623 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.430623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.430704 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:16.430748 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:16.430882 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 18:58:16.430932 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560}
I20260811 18:58:16.431048 21999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.425458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33873 (local address 127.5.226.67:55005)
0811 18:58:16.425585 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:16.425595 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:16.425640 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:16.426227 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:16.426228 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:16.426422 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:16.426503 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.426506 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.427241 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.427242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.427732 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.427733 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.428132 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.428133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.428177 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.428543 (+ 366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:16.428547 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:16.428841 (+ 294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:16.430173 (+ 1332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:16.430175 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:16.430175 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:16.430369 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:16.430510 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:16.430511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:16.430511 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:16.430570 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:16.430754 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:16.430755 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:16.430798 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 18:58:16.430864 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 18:58:16.430956 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":76,"threads_started":1}
Aug 11 18:58:16 dist-test-slave-gjw7 krb5kdc[20997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474696, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:58:16 dist-test-slave-gjw7 krb5kdc[20997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:16 dist-test-slave-gjw7 krb5kdc[20997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:58:16.448606 21173 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:16.443681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37494 (local address 127.5.226.126:33873)
0811 18:58:16.443732 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.443734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.443742 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:58:16.443779 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.443780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.443790 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.443826 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:16.444365 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.444861 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.445667 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.445852 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.445901 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.448544 (+ 2643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37494: BlockingRecv error: recv got EOF from 127.0.0.1:37494 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 11 18:58:16 dist-test-slave-gjw7 krb5kdc[20997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474696, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:16.455330 21173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.449388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37504 (local address 127.5.226.126:33873)
0811 18:58:16.449426 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.449428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.449476 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:58:16.449546 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.449547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.449556 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.449608 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:16.450060 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.450521 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.451175 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.451370 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.451423 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.453328 (+ 1905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:16.453329 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:16.453329 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:16.453337 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:16.454364 (+ 1027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.454654 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.454655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.454655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.454723 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.454888 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.454889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.454889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.454988 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:16.455073 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:16.455169 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 18:58:16.455242 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:58:16.456679 21088 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37504:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:58:16.458276 21088 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:58:16.464622 22025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.460571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42674 (local address 127.5.226.65:34139)
0811 18:58:16.460759 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.460764 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.460774 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:58:16.460828 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.460830 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.460845 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.460919 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:16.461106 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.462230 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.463486 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.464175 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.464250 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.464346 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:16.464475 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 18:58:16.464517 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":76,"threads_started":1}
I20260811 18:58:16.464622 22023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.460375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:42705 (local address 127.0.0.1:52404)
0811 18:58:16.460950 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:16.460959 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:16.460992 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:16.461259 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:16.461260 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:16.461262 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:16.461324 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.461326 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.462497 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.462498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.463369 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.463372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.464279 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.464280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.464354 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.464370 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 18:58:16.464451 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 18:58:16.464518 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"mutex_wait_us":28,"thread_start_us":96,"threads_started":1}
I20260811 18:58:16.464623 22020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.460360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:34139 (local address 127.0.0.1:42674)
0811 18:58:16.460516 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:16.460557 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:16.460629 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:16.460936 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:16.460940 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:16.460943 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:16.461006 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.461008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.462327 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.462329 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.463416 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.463417 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.464263 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.464264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.464362 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.464371 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 18:58:16.464451 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 18:58:16.464518 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":41,"thread_start_us":48,"threads_started":1}
I20260811 18:58:16.465016 22026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.460597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52404 (local address 127.5.226.67:42705)
0811 18:58:16.461050 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.461054 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.461063 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:16.461099 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.461101 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.461116 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.461188 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:16.461406 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.462429 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.463440 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.464175 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.464250 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.464332 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:16.464879 (+ 547us) server_negotiation.cc:299] Negotiation successful
0811 18:58:16.464923 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":90,"threads_started":1}
I20260811 18:58:16.465746 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.460632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45750 (local address 127.5.226.66:42923)
0811 18:58:16.460802 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.460806 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.460874 (+ 68us) server_negotiation.cc:407] Connection header received
0811 18:58:16.460965 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.460971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.460988 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.461059 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:16.461262 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.462012 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.464383 (+ 2371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.465358 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.465428 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.465501 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:16.465624 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 18:58:16.465667 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":89,"threads_started":1}
I20260811 18:58:16.465745 22024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.460360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:42923 (local address 127.0.0.1:45750)
0811 18:58:16.460816 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:16.460826 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:16.460878 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:16.461133 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:16.461134 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:16.461136 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:16.461190 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.461192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.462093 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.462094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.463403 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.463407 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.465490 (+ 2083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.465491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.465555 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.465559 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:58:16.465610 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 18:58:16.465651 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"mutex_wait_us":4,"thread_start_us":95,"threads_started":1}
I20260811 18:58:16.465843 21335 tablet_service.cc:1467] Processing CreateTablet for tablet 63b9c820e1884243a5773cbd4eed97e8 (DEFAULT_TABLE table=test-table [id=993103fea6ff4454ac28cfd5d6b7eac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:16.466177 21335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63b9c820e1884243a5773cbd4eed97e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:16.466327 21597 tablet_service.cc:1467] Processing CreateTablet for tablet 63b9c820e1884243a5773cbd4eed97e8 (DEFAULT_TABLE table=test-table [id=993103fea6ff4454ac28cfd5d6b7eac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:16.466584 21597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63b9c820e1884243a5773cbd4eed97e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:16.469506 22031 tablet_bootstrap.cc:492] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b: Bootstrap starting.
I20260811 18:58:16.469775 21863 tablet_service.cc:1467] Processing CreateTablet for tablet 63b9c820e1884243a5773cbd4eed97e8 (DEFAULT_TABLE table=test-table [id=993103fea6ff4454ac28cfd5d6b7eac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:16.470043 21863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63b9c820e1884243a5773cbd4eed97e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:16.470103 22031 tablet_bootstrap.cc:654] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:16.470353 22031 log.cc:824] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:16.471064 22031 tablet_bootstrap.cc:492] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b: No bootstrap required, opened a new log
I20260811 18:58:16.471112 22031 ts_tablet_manager.cc:1397] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:58:16.472617 22031 raft_consensus.cc:348] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.472765 22031 raft_consensus.cc:374] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:16.472786 22031 raft_consensus.cc:729] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef460c8798a74a25b3e39691aea0a73b, State: Initialized, Role: FOLLOWER
I20260811 18:58:16.472873 22039 tablet_bootstrap.cc:492] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Bootstrap starting.
I20260811 18:58:16.472879 22031 consensus_queue.cc:260] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.473143 22031 ts_tablet_manager.cc:1428] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:58:16.473165 21460 heartbeater.cc:503] Master 127.5.226.126:33873 was elected leader, sending a full tablet report...
I20260811 18:58:16.473490 22035 tablet_bootstrap.cc:492] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122: Bootstrap starting.
I20260811 18:58:16.473526 22039 tablet_bootstrap.cc:654] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:16.473798 22039 log.cc:824] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:16.474124 22035 tablet_bootstrap.cc:654] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:16.474459 22035 log.cc:824] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:16.474498 22039 tablet_bootstrap.cc:492] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5: No bootstrap required, opened a new log
I20260811 18:58:16.474545 22039 ts_tablet_manager.cc:1397] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:58:16.475137 22035 tablet_bootstrap.cc:492] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122: No bootstrap required, opened a new log
I20260811 18:58:16.475193 22035 ts_tablet_manager.cc:1397] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:58:16.476024 22039 raft_consensus.cc:348] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.476186 22039 raft_consensus.cc:374] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:16.476228 22039 raft_consensus.cc:729] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dc94c704ce548dfbb3d3f839fb6e8d5, State: Initialized, Role: FOLLOWER
I20260811 18:58:16.476356 22039 consensus_queue.cc:260] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.476617 22039 ts_tablet_manager.cc:1428] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:58:16.476678 21987 heartbeater.cc:503] Master 127.5.226.126:33873 was elected leader, sending a full tablet report...
I20260811 18:58:16.476817 22035 raft_consensus.cc:348] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.476970 22035 raft_consensus.cc:374] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:16.477012 22035 raft_consensus.cc:729] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a5df1a57e344aba28d86bb3f278122, State: Initialized, Role: FOLLOWER
I20260811 18:58:16.477120 22035 consensus_queue.cc:260] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.477424 22035 ts_tablet_manager.cc:1428] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 18:58:16.477494 21714 heartbeater.cc:503] Master 127.5.226.126:33873 was elected leader, sending a full tablet report...
W20260811 18:58:16.514972 21715 tablet.cc:2369] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:58:16.585404 21464 tablet.cc:2369] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:58:16.597648 22048 raft_consensus.cc:482] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:16.597791 22048 raft_consensus.cc:504] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.598157 22048 leader_election.cc:288] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef460c8798a74a25b3e39691aea0a73b (127.5.226.65:34139), 9dc94c704ce548dfbb3d3f839fb6e8d5 (127.5.226.67:42705)
I20260811 18:58:16.600950 22025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.598404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:34805 (local address 127.5.226.65:34139)
0811 18:58:16.598447 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.598449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.598643 (+ 194us) server_negotiation.cc:407] Connection header received
0811 18:58:16.598721 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.598722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.598732 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.598779 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:16.598928 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.599393 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.600299 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.600643 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.600711 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.600720 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:16.600848 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 18:58:16.600880 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:58:16.600973 22049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.598353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:34139 (local address 127.5.226.66:34805)
0811 18:58:16.598559 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:16.598570 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:16.598644 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:16.598789 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:16.598789 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:16.598791 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:16.598872 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.598873 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.599468 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.599469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.600215 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.600217 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.600712 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.600713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.600789 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.600793 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:58:16.600839 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 18:58:16.600877 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":16,"thread_start_us":120,"threads_started":1}
I20260811 18:58:16.601389 21382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63b9c820e1884243a5773cbd4eed97e8" candidate_uuid: "a6a5df1a57e344aba28d86bb3f278122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef460c8798a74a25b3e39691aea0a73b" is_pre_election: true
I20260811 18:58:16.601540 21521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.598353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:42705 (local address 127.5.226.66:60031)
0811 18:58:16.598418 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:16.598430 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:16.598477 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:16.598729 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:16.598730 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:16.598732 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:16.598800 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.598801 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.599451 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.599452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.600242 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.600245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.600740 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.600741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.601363 (+ 622us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.601367 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:58:16.601430 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 18:58:16.601470 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":1}
I20260811 18:58:16.601569 21382 raft_consensus.cc:2454] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a5df1a57e344aba28d86bb3f278122 in term 0.
I20260811 18:58:16.601601 22026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.598550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:60031 (local address 127.5.226.67:42705)
0811 18:58:16.598613 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.598615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.598622 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:58:16.598649 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.598650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.598658 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.598702 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:16.598859 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.599379 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.600318 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.600669 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.600727 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.600736 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:16.601470 (+ 734us) server_negotiation.cc:299] Negotiation successful
0811 18:58:16.601537 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 18:58:16.601822 21514 leader_election.cc:302] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6a5df1a57e344aba28d86bb3f278122, ef460c8798a74a25b3e39691aea0a73b; no voters:
I20260811 18:58:16.601958 22048 raft_consensus.cc:2781] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:58:16.602031 22048 raft_consensus.cc:482] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:16.601990 21899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63b9c820e1884243a5773cbd4eed97e8" candidate_uuid: "a6a5df1a57e344aba28d86bb3f278122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" is_pre_election: true
I20260811 18:58:16.602057 22048 raft_consensus.cc:3037] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:16.602118 21899 raft_consensus.cc:2454] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a5df1a57e344aba28d86bb3f278122 in term 0.
I20260811 18:58:16.602818 22048 raft_consensus.cc:504] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.602955 22048 leader_election.cc:288] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [CANDIDATE]: Term 1 election: Requested vote from peers ef460c8798a74a25b3e39691aea0a73b (127.5.226.65:34139), 9dc94c704ce548dfbb3d3f839fb6e8d5 (127.5.226.67:42705)
I20260811 18:58:16.603152 21382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63b9c820e1884243a5773cbd4eed97e8" candidate_uuid: "a6a5df1a57e344aba28d86bb3f278122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef460c8798a74a25b3e39691aea0a73b"
I20260811 18:58:16.603219 21899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63b9c820e1884243a5773cbd4eed97e8" candidate_uuid: "a6a5df1a57e344aba28d86bb3f278122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5"
I20260811 18:58:16.603298 21382 raft_consensus.cc:3037] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:16.603298 21899 raft_consensus.cc:3037] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:16.604205 21382 raft_consensus.cc:2454] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a5df1a57e344aba28d86bb3f278122 in term 1.
I20260811 18:58:16.604199 21899 raft_consensus.cc:2454] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a5df1a57e344aba28d86bb3f278122 in term 1.
I20260811 18:58:16.604377 21514 leader_election.cc:302] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6a5df1a57e344aba28d86bb3f278122, ef460c8798a74a25b3e39691aea0a73b; no voters:
I20260811 18:58:16.604471 22048 raft_consensus.cc:2781] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:16.604599 22048 raft_consensus.cc:686] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [term 1 LEADER]: Becoming Leader. State: Replica: a6a5df1a57e344aba28d86bb3f278122, State: Running, Role: LEADER
I20260811 18:58:16.604708 22048 consensus_queue.cc:237] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.605608 21088 catalog_manager.cc:5495] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a5df1a57e344aba28d86bb3f278122 (127.5.226.66). New cstate: current_term: 1 leader_uuid: "a6a5df1a57e344aba28d86bb3f278122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260811 18:58:16.644122 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.641909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45764 (local address 127.5.226.66:42923)
0811 18:58:16.641961 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.641963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.641987 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:58:16.642029 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.642030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.642052 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.642108 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:16.642222 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.642705 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.643457 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.643660 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.643720 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.643842 (+ 122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:16.643946 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:16.644005 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:16.644018 (+ 13us) server_negotiation.cc:299] Negotiation successful
0811 18:58:16.644040 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:58:16.646098 21899 raft_consensus.cc:1261] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Refusing update from remote peer a6a5df1a57e344aba28d86bb3f278122: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:16.646098 21382 raft_consensus.cc:1261] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Refusing update from remote peer a6a5df1a57e344aba28d86bb3f278122: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:16.646432 22048 consensus_queue.cc:1035] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:16.646574 22052 consensus_queue.cc:1035] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:16.649243 22058 mvcc.cc:205] Tried to move back new op lower bound from 7317400357459423232 to 7317400357293580288. Current Snapshot: MvccSnapshot[applied={T|T < 7317400357459423232}]
I20260811 18:58:16.649413 22063 mvcc.cc:205] Tried to move back new op lower bound from 7317400357459423232 to 7317400357293580288. Current Snapshot: MvccSnapshot[applied={T|T < 7317400357459423232}]
I20260811 18:58:16.649789 22062 mvcc.cc:205] Tried to move back new op lower bound from 7317400357459423232 to 7317400357293580288. Current Snapshot: MvccSnapshot[applied={T|T < 7317400357459423232}]
I20260811 18:58:16.651325 21091 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:16.651427 21091 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:16.652161 21091 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f: Sending DeleteTablet for 3 replicas of tablet 63b9c820e1884243a5773cbd4eed97e8
I20260811 18:58:16.652474 21597 tablet_service.cc:1514] Processing DeleteTablet for tablet 63b9c820e1884243a5773cbd4eed97e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:16 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:45750
I20260811 18:58:16.652524 21863 tablet_service.cc:1514] Processing DeleteTablet for tablet 63b9c820e1884243a5773cbd4eed97e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:16 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:52404
I20260811 18:58:16.652825 21335 tablet_service.cc:1514] Processing DeleteTablet for tablet 63b9c820e1884243a5773cbd4eed97e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:16 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:42674
I20260811 18:58:16.652865 21091 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37504:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 18:58:16.653004 22079 tablet_replica.cc:330] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b: stopping tablet replica
W20260811 18:58:16.653012 21091 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:58:16.653088 22079 raft_consensus.cc:2229] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:16.653187 22079 raft_consensus.cc:2258] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:16.653373 22075 tablet_replica.cc:330] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122: stopping tablet replica
I20260811 18:58:16.653470 22075 raft_consensus.cc:2229] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:58:16.653570 22075 raft_consensus.cc:2258] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:16.654047 22079 ts_tablet_manager.cc:1905] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:16.654345 21335 tablet_service.cc:1467] Processing CreateTablet for tablet 3e282a654c0e4fe0a551e97d4817b597 (DEFAULT_TABLE table=test-table [id=28c1de5815bf4105a5e0cbc4bc9ab65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:16.654392 21863 tablet_service.cc:1467] Processing CreateTablet for tablet 3e282a654c0e4fe0a551e97d4817b597 (DEFAULT_TABLE table=test-table [id=28c1de5815bf4105a5e0cbc4bc9ab65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:16.654460 21335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e282a654c0e4fe0a551e97d4817b597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:16.654484 21863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e282a654c0e4fe0a551e97d4817b597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:16.655865 22031 tablet_bootstrap.cc:492] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b: Bootstrap starting.
I20260811 18:58:16.656286 22031 tablet_bootstrap.cc:654] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:16.656625 22039 tablet_bootstrap.cc:492] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Bootstrap starting.
I20260811 18:58:16.657042 22039 tablet_bootstrap.cc:654] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:16.657140 22076 tablet_replica.cc:330] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5: stopping tablet replica
I20260811 18:58:16.657230 22076 raft_consensus.cc:2229] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:16.657369 22076 raft_consensus.cc:2258] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:16.657656 21597 tablet_service.cc:1467] Processing CreateTablet for tablet 3e282a654c0e4fe0a551e97d4817b597 (DEFAULT_TABLE table=test-table [id=28c1de5815bf4105a5e0cbc4bc9ab65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:16.657686 22075 ts_tablet_manager.cc:1905] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:16.657886 21597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e282a654c0e4fe0a551e97d4817b597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:16.657997 22031 tablet_bootstrap.cc:492] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b: No bootstrap required, opened a new log
I20260811 18:58:16.658037 22031 ts_tablet_manager.cc:1397] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:58:16.658170 22031 raft_consensus.cc:348] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.658241 22031 raft_consensus.cc:374] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:16.658259 22031 raft_consensus.cc:729] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef460c8798a74a25b3e39691aea0a73b, State: Initialized, Role: FOLLOWER
I20260811 18:58:16.658301 22031 consensus_queue.cc:260] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.658396 22031 ts_tablet_manager.cc:1428] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:16.659036 22039 tablet_bootstrap.cc:492] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5: No bootstrap required, opened a new log
I20260811 18:58:16.659078 22039 ts_tablet_manager.cc:1397] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 18:58:16.659228 22039 raft_consensus.cc:348] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.659304 22039 raft_consensus.cc:374] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:16.659328 22039 raft_consensus.cc:729] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dc94c704ce548dfbb3d3f839fb6e8d5, State: Initialized, Role: FOLLOWER
I20260811 18:58:16.659317 22075 ts_tablet_manager.cc:1918] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:16.659377 22075 log.cc:1196] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/63b9c820e1884243a5773cbd4eed97e8
I20260811 18:58:16.659376 22039 consensus_queue.cc:260] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.659458 22039 ts_tablet_manager.cc:1428] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:16.659543 22035 tablet_bootstrap.cc:492] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122: Bootstrap starting.
I20260811 18:58:16.659636 22075 ts_tablet_manager.cc:1939] T 63b9c820e1884243a5773cbd4eed97e8 P a6a5df1a57e344aba28d86bb3f278122: Deleting consensus metadata
I20260811 18:58:16.659931 22035 tablet_bootstrap.cc:654] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:16.660038 22079 ts_tablet_manager.cc:1918] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:16.660112 22079 log.cc:1196] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/wal/wals/63b9c820e1884243a5773cbd4eed97e8
I20260811 18:58:16.660678 22079 ts_tablet_manager.cc:1939] T 63b9c820e1884243a5773cbd4eed97e8 P ef460c8798a74a25b3e39691aea0a73b: Deleting consensus metadata
I20260811 18:58:16.660823 21053 catalog_manager.cc:4841] TS a6a5df1a57e344aba28d86bb3f278122 (127.5.226.66:42923): tablet 63b9c820e1884243a5773cbd4eed97e8 (table test-table [id=993103fea6ff4454ac28cfd5d6b7eac8]) successfully deleted
I20260811 18:58:16.661048 22035 tablet_bootstrap.cc:492] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122: No bootstrap required, opened a new log
I20260811 18:58:16.661098 22035 ts_tablet_manager.cc:1397] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 18:58:16.661108 21057 catalog_manager.cc:4841] TS ef460c8798a74a25b3e39691aea0a73b (127.5.226.65:34139): tablet 63b9c820e1884243a5773cbd4eed97e8 (table test-table [id=993103fea6ff4454ac28cfd5d6b7eac8]) successfully deleted
I20260811 18:58:16.661252 22035 raft_consensus.cc:348] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.661367 22035 raft_consensus.cc:374] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:16.661397 22035 raft_consensus.cc:729] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a5df1a57e344aba28d86bb3f278122, State: Initialized, Role: FOLLOWER
I20260811 18:58:16.661445 22076 ts_tablet_manager.cc:1905] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:16.661438 22035 consensus_queue.cc:260] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.661536 22035 ts_tablet_manager.cc:1428] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:16.662863 22076 ts_tablet_manager.cc:1918] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:16.662921 22076 log.cc:1196] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/63b9c820e1884243a5773cbd4eed97e8
I20260811 18:58:16.663122 22076 ts_tablet_manager.cc:1939] T 63b9c820e1884243a5773cbd4eed97e8 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Deleting consensus metadata
I20260811 18:58:16.663461 21055 catalog_manager.cc:4841] TS 9dc94c704ce548dfbb3d3f839fb6e8d5 (127.5.226.67:42705): tablet 63b9c820e1884243a5773cbd4eed97e8 (table test-table [id=993103fea6ff4454ac28cfd5d6b7eac8]) successfully deleted
W20260811 18:58:16.671622 21992 tablet.cc:2369] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:58:16.876362 22048 raft_consensus.cc:482] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:16.876477 22048 raft_consensus.cc:504] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.876621 22048 leader_election.cc:288] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef460c8798a74a25b3e39691aea0a73b (127.5.226.65:34139), 9dc94c704ce548dfbb3d3f839fb6e8d5 (127.5.226.67:42705)
I20260811 18:58:16.876892 21382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e282a654c0e4fe0a551e97d4817b597" candidate_uuid: "a6a5df1a57e344aba28d86bb3f278122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef460c8798a74a25b3e39691aea0a73b" is_pre_election: true
I20260811 18:58:16.876891 21899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e282a654c0e4fe0a551e97d4817b597" candidate_uuid: "a6a5df1a57e344aba28d86bb3f278122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" is_pre_election: true
I20260811 18:58:16.876988 21382 raft_consensus.cc:2454] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a5df1a57e344aba28d86bb3f278122 in term 0.
I20260811 18:58:16.876994 21899 raft_consensus.cc:2454] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a5df1a57e344aba28d86bb3f278122 in term 0.
I20260811 18:58:16.877132 21514 leader_election.cc:302] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6a5df1a57e344aba28d86bb3f278122, ef460c8798a74a25b3e39691aea0a73b; no voters:
I20260811 18:58:16.877272 22048 raft_consensus.cc:2781] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:58:16.877347 22048 raft_consensus.cc:482] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:16.877369 22048 raft_consensus.cc:3037] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:16.878041 22048 raft_consensus.cc:504] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.878170 22048 leader_election.cc:288] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [CANDIDATE]: Term 1 election: Requested vote from peers ef460c8798a74a25b3e39691aea0a73b (127.5.226.65:34139), 9dc94c704ce548dfbb3d3f839fb6e8d5 (127.5.226.67:42705)
I20260811 18:58:16.878364 21899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e282a654c0e4fe0a551e97d4817b597" candidate_uuid: "a6a5df1a57e344aba28d86bb3f278122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5"
I20260811 18:58:16.878348 21382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e282a654c0e4fe0a551e97d4817b597" candidate_uuid: "a6a5df1a57e344aba28d86bb3f278122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef460c8798a74a25b3e39691aea0a73b"
I20260811 18:58:16.878432 21899 raft_consensus.cc:3037] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:16.878432 21382 raft_consensus.cc:3037] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:16.879199 21899 raft_consensus.cc:2454] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a5df1a57e344aba28d86bb3f278122 in term 1.
I20260811 18:58:16.879208 21382 raft_consensus.cc:2454] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a5df1a57e344aba28d86bb3f278122 in term 1.
I20260811 18:58:16.879398 21510 leader_election.cc:302] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9dc94c704ce548dfbb3d3f839fb6e8d5, a6a5df1a57e344aba28d86bb3f278122, ef460c8798a74a25b3e39691aea0a73b; no voters:
I20260811 18:58:16.879508 22048 raft_consensus.cc:2781] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:16.879575 22048 raft_consensus.cc:686] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [term 1 LEADER]: Becoming Leader. State: Replica: a6a5df1a57e344aba28d86bb3f278122, State: Running, Role: LEADER
I20260811 18:58:16.879631 22048 consensus_queue.cc:237] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.880201 21091 catalog_manager.cc:5495] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a5df1a57e344aba28d86bb3f278122 (127.5.226.66). New cstate: current_term: 1 leader_uuid: "a6a5df1a57e344aba28d86bb3f278122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } health_report { overall_health: UNKNOWN } } }
Aug 11 18:58:16 dist-test-slave-gjw7 krb5kdc[20997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474695, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.126@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:16.908407 21173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.901978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37518 (local address 127.5.226.126:33873)
0811 18:58:16.902038 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:16.902040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:16.902164 (+ 124us) server_negotiation.cc:407] Connection header received
0811 18:58:16.902217 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:16.902218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:16.902228 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:16.902277 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:16.902698 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.903191 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.903868 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.904054 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.904101 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.906113 (+ 2012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:16.906114 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:16.906115 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:16.906121 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:16.907352 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.907692 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.907693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.907693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.907740 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:16.907955 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:16.907955 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:16.907956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:16.908049 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:16.908093 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:16.908277 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 18:58:16.908341 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 18:58:16.908522 22096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:16.901924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33873 (local address 127.0.0.1:37518)
0811 18:58:16.902092 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:16.902102 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:16.902167 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:16.902292 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:16.902293 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:16.902587 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:16.902637 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.902639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.903274 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.903274 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.903794 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:16.903796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:16.904106 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:16.904107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:16.904147 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:16.904630 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:16.904634 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:16.906037 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:16.907432 (+ 1395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:16.907440 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:16.907442 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:16.907637 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:16.907818 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:16.907819 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:16.907820 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:16.907899 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:16.908132 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:16.908140 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:16.908190 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 18:58:16.908259 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 18:58:16.908413 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":55,"thread_start_us":81,"threads_started":1}
I20260811 18:58:16.910334 21091 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:37518:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 18:58:16.910517 21091 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:58:16.911888 21597 tablet_service.cc:1467] Processing CreateTablet for tablet 8a64b73ccda94c968340b931608cc298 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=81f8b3b5546b483fafe95205f71fce9d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:58:16.911888 21335 tablet_service.cc:1467] Processing CreateTablet for tablet 8a64b73ccda94c968340b931608cc298 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=81f8b3b5546b483fafe95205f71fce9d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:58:16.911954 21863 tablet_service.cc:1467] Processing CreateTablet for tablet 8a64b73ccda94c968340b931608cc298 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=81f8b3b5546b483fafe95205f71fce9d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:58:16.912052 21597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a64b73ccda94c968340b931608cc298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:16.912052 21335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a64b73ccda94c968340b931608cc298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:16.912106 21863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a64b73ccda94c968340b931608cc298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:16.913218 22039 tablet_bootstrap.cc:492] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Bootstrap starting.
I20260811 18:58:16.913527 22035 tablet_bootstrap.cc:492] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122: Bootstrap starting.
I20260811 18:58:16.913527 22031 tablet_bootstrap.cc:492] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b: Bootstrap starting.
I20260811 18:58:16.913654 22039 tablet_bootstrap.cc:654] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:16.913849 22035 tablet_bootstrap.cc:654] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:16.913889 22031 tablet_bootstrap.cc:654] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:16.914451 22035 tablet_bootstrap.cc:492] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122: No bootstrap required, opened a new log
I20260811 18:58:16.914466 22039 tablet_bootstrap.cc:492] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5: No bootstrap required, opened a new log
I20260811 18:58:16.914503 22035 ts_tablet_manager.cc:1397] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 18:58:16.914510 22039 ts_tablet_manager.cc:1397] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 18:58:16.914549 22031 tablet_bootstrap.cc:492] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b: No bootstrap required, opened a new log
I20260811 18:58:16.914597 22031 ts_tablet_manager.cc:1397] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:16.914630 22035 raft_consensus.cc:348] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.914705 22035 raft_consensus.cc:374] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:16.914667 22039 raft_consensus.cc:348] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.914728 22035 raft_consensus.cc:729] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a5df1a57e344aba28d86bb3f278122, State: Initialized, Role: FOLLOWER
I20260811 18:58:16.914733 22039 raft_consensus.cc:374] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:16.914752 22039 raft_consensus.cc:729] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dc94c704ce548dfbb3d3f839fb6e8d5, State: Initialized, Role: FOLLOWER
I20260811 18:58:16.914728 22031 raft_consensus.cc:348] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.914786 22031 raft_consensus.cc:374] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:16.914769 22035 consensus_queue.cc:260] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.914811 22031 raft_consensus.cc:729] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef460c8798a74a25b3e39691aea0a73b, State: Initialized, Role: FOLLOWER
I20260811 18:58:16.914808 22039 consensus_queue.cc:260] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.914847 22031 consensus_queue.cc:260] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:16.914863 22035 ts_tablet_manager.cc:1428] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:16.914901 22039 ts_tablet_manager.cc:1428] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:16.914923 22031 ts_tablet_manager.cc:1428] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:16.915012 22048 tablet_replica.cc:439] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } } }
I20260811 18:58:16.915037 22044 tablet_replica.cc:439] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } } }
I20260811 18:58:16.915107 22044 tablet_replica.cc:442] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:58:16.915103 22048 tablet_replica.cc:442] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:58:16.915261 22041 tablet_replica.cc:439] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } } }
I20260811 18:58:16.915366 22041 tablet_replica.cc:442] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:58:17.043566 22048 raft_consensus.cc:482] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:17.043707 22048 raft_consensus.cc:504] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.043916 22048 leader_election.cc:288] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef460c8798a74a25b3e39691aea0a73b (127.5.226.65:34139), 9dc94c704ce548dfbb3d3f839fb6e8d5 (127.5.226.67:42705)
I20260811 18:58:17.044171 21382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a64b73ccda94c968340b931608cc298" candidate_uuid: "a6a5df1a57e344aba28d86bb3f278122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef460c8798a74a25b3e39691aea0a73b" is_pre_election: true
I20260811 18:58:17.044168 21899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a64b73ccda94c968340b931608cc298" candidate_uuid: "a6a5df1a57e344aba28d86bb3f278122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" is_pre_election: true
I20260811 18:58:17.044276 21382 raft_consensus.cc:2454] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a5df1a57e344aba28d86bb3f278122 in term 0.
I20260811 18:58:17.044281 21899 raft_consensus.cc:2454] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a5df1a57e344aba28d86bb3f278122 in term 0.
I20260811 18:58:17.044447 21514 leader_election.cc:302] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6a5df1a57e344aba28d86bb3f278122, ef460c8798a74a25b3e39691aea0a73b; no voters:
I20260811 18:58:17.044550 22048 raft_consensus.cc:2781] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:58:17.044591 22048 raft_consensus.cc:482] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:17.044615 22048 raft_consensus.cc:3037] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:17.045452 22048 raft_consensus.cc:504] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.045600 22048 leader_election.cc:288] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [CANDIDATE]: Term 1 election: Requested vote from peers ef460c8798a74a25b3e39691aea0a73b (127.5.226.65:34139), 9dc94c704ce548dfbb3d3f839fb6e8d5 (127.5.226.67:42705)
I20260811 18:58:17.045754 21899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a64b73ccda94c968340b931608cc298" candidate_uuid: "a6a5df1a57e344aba28d86bb3f278122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5"
I20260811 18:58:17.045758 21382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a64b73ccda94c968340b931608cc298" candidate_uuid: "a6a5df1a57e344aba28d86bb3f278122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef460c8798a74a25b3e39691aea0a73b"
I20260811 18:58:17.045840 21382 raft_consensus.cc:3037] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:17.045840 21899 raft_consensus.cc:3037] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:17.046612 21382 raft_consensus.cc:2454] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a5df1a57e344aba28d86bb3f278122 in term 1.
I20260811 18:58:17.046612 21899 raft_consensus.cc:2454] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a5df1a57e344aba28d86bb3f278122 in term 1.
I20260811 18:58:17.046789 21514 leader_election.cc:302] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9dc94c704ce548dfbb3d3f839fb6e8d5, a6a5df1a57e344aba28d86bb3f278122, ef460c8798a74a25b3e39691aea0a73b; no voters:
I20260811 18:58:17.046885 22048 raft_consensus.cc:2781] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:17.046942 22048 raft_consensus.cc:686] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [term 1 LEADER]: Becoming Leader. State: Replica: a6a5df1a57e344aba28d86bb3f278122, State: Running, Role: LEADER
I20260811 18:58:17.046996 22048 consensus_queue.cc:237] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.047295 22070 tablet_replica.cc:439] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122: TxnStatusTablet state changed. Reason: New leader a6a5df1a57e344aba28d86bb3f278122. Latest consensus state: current_term: 1 leader_uuid: "a6a5df1a57e344aba28d86bb3f278122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } } }
I20260811 18:58:17.047389 22070 tablet_replica.cc:442] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:58:17.047536 22103 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 18:58:17.047660 22103 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 18:58:17.047608 21088 catalog_manager.cc:5495] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a5df1a57e344aba28d86bb3f278122 (127.5.226.66). New cstate: current_term: 1 leader_uuid: "a6a5df1a57e344aba28d86bb3f278122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260811 18:58:17.060225 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.058057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45770 (local address 127.5.226.66:42923)
0811 18:58:17.058112 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:17.058114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:17.058125 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:58:17.058230 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:17.058231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:17.058243 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:17.058291 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:17.058416 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.058877 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.059594 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.059782 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.059835 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.059985 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:17.060019 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:17.060059 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:17.060115 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 18:58:17.060139 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 18:58:17.060230 22096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.057972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:42923 (local address 127.0.0.1:45770)
0811 18:58:17.058073 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:17.058087 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:17.058147 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:17.058305 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:17.058306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:17.058307 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:58:17.058360 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.058362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.058946 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.058947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.059520 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.059522 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.059842 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.059843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.059902 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.059917 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:58:17.060066 (+ 149us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:58:17.060073 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 18:58:17.060113 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 18:58:17.060165 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 18:58:17.061328 21899 raft_consensus.cc:1261] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Refusing update from remote peer a6a5df1a57e344aba28d86bb3f278122: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:17.061328 21382 raft_consensus.cc:1261] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Refusing update from remote peer a6a5df1a57e344aba28d86bb3f278122: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:17.061543 22070 consensus_queue.cc:1035] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:17.061652 22048 consensus_queue.cc:1035] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:17.062127 22044 tablet_replica.cc:439] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5: TxnStatusTablet state changed. Reason: New leader a6a5df1a57e344aba28d86bb3f278122. Latest consensus state: current_term: 1 leader_uuid: "a6a5df1a57e344aba28d86bb3f278122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } } }
I20260811 18:58:17.062219 22044 tablet_replica.cc:442] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:58:17.062191 22041 tablet_replica.cc:439] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b: TxnStatusTablet state changed. Reason: New leader a6a5df1a57e344aba28d86bb3f278122. Latest consensus state: current_term: 1 leader_uuid: "a6a5df1a57e344aba28d86bb3f278122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } } }
I20260811 18:58:17.062273 22041 tablet_replica.cc:442] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:58:17.062868 22052 tablet_replica.cc:439] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a6a5df1a57e344aba28d86bb3f278122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } } }
I20260811 18:58:17.062955 22052 tablet_replica.cc:442] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:58:17.063138 22041 tablet_replica.cc:439] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a6a5df1a57e344aba28d86bb3f278122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } } }
I20260811 18:58:17.063231 22041 tablet_replica.cc:442] T 8a64b73ccda94c968340b931608cc298 P ef460c8798a74a25b3e39691aea0a73b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:58:17.063911 22070 tablet_replica.cc:439] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a6a5df1a57e344aba28d86bb3f278122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } } }
I20260811 18:58:17.063990 22070 tablet_replica.cc:442] T 8a64b73ccda94c968340b931608cc298 P a6a5df1a57e344aba28d86bb3f278122: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:58:17.064177 22044 tablet_replica.cc:439] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a6a5df1a57e344aba28d86bb3f278122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } } }
I20260811 18:58:17.064260 22044 tablet_replica.cc:442] T 8a64b73ccda94c968340b931608cc298 P 9dc94c704ce548dfbb3d3f839fb6e8d5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:58:17.068773 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.066264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:58221 (local address 127.5.226.66:42923)
0811 18:58:17.066297 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:17.066299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:17.066386 (+ 87us) server_negotiation.cc:407] Connection header received
0811 18:58:17.066446 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:17.066446 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:17.066454 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:17.066495 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:17.066601 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.067027 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.068128 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.068335 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.068388 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.068543 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:17.068564 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:17.068594 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:17.068658 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 18:58:17.068692 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":14,"server-negotiator.queue_time_us":14}
I20260811 18:58:17.068845 22113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.066176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:42923 (local address 127.5.226.66:58221)
0811 18:58:17.066326 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:17.066337 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:17.066393 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:17.066501 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:17.066502 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:17.066503 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:58:17.066551 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.066553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.067085 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.067086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.068048 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.068050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.068402 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.068403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.068459 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.068476 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:58:17.068610 (+ 134us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:58:17.068612 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:58:17.068656 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 18:58:17.068713 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":2,"thread_start_us":69,"threads_started":1}
I20260811 18:58:17.070695 21382 raft_consensus.cc:1261] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Refusing update from remote peer a6a5df1a57e344aba28d86bb3f278122: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:17.070713 21899 raft_consensus.cc:1261] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Refusing update from remote peer a6a5df1a57e344aba28d86bb3f278122: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:17.070883 22070 consensus_queue.cc:1035] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:17.070977 22052 consensus_queue.cc:1035] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:17.081015 21088 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:17.081102 21088 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:17.081712 21088 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f: Sending DeleteTablet for 3 replicas of tablet 3e282a654c0e4fe0a551e97d4817b597
I20260811 18:58:17.081923 21335 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e282a654c0e4fe0a551e97d4817b597 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:17 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:42674
I20260811 18:58:17.081954 21863 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e282a654c0e4fe0a551e97d4817b597 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:17 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:52404
I20260811 18:58:17.082017 22079 tablet_replica.cc:330] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b: stopping tablet replica
I20260811 18:58:17.082044 22076 tablet_replica.cc:330] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5: stopping tablet replica
I20260811 18:58:17.082067 22079 raft_consensus.cc:2229] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:17.082095 22076 raft_consensus.cc:2229] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:17.082103 22079 pending_rounds.cc:62] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b: Trying to abort 2 pending ops.
I20260811 18:58:17.082162 22076 raft_consensus.cc:2258] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:17.082121 22079 pending_rounds.cc:68] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7317400359200403456 op_type: PARTICIPANT_OP participant_request { tablet_id: "3e282a654c0e4fe0a551e97d4817b597" op { type: BEGIN_TXN txn_id: 0 } }
I20260811 18:58:17.082238 22079 pending_rounds.cc:68] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317400358419390464 op_type: NO_OP noop_request { }
I20260811 18:58:17.082276 22079 raft_consensus.cc:2866] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 18:58:17.082307 22079 raft_consensus.cc:2258] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:17.082554 22076 ts_tablet_manager.cc:1905] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:17.082934 22079 ts_tablet_manager.cc:1905] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:17.084414 22079 ts_tablet_manager.cc:1918] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:17.084478 22079 log.cc:1196] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/wal/wals/3e282a654c0e4fe0a551e97d4817b597
I20260811 18:58:17.084674 22079 ts_tablet_manager.cc:1939] T 3e282a654c0e4fe0a551e97d4817b597 P ef460c8798a74a25b3e39691aea0a73b: Deleting consensus metadata
I20260811 18:58:17.085041 21597 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e282a654c0e4fe0a551e97d4817b597 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:17 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:45750
I20260811 18:58:17.085129 22075 tablet_replica.cc:330] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122: stopping tablet replica
I20260811 18:58:17.085173 22075 raft_consensus.cc:2229] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:58:17.085232 22075 raft_consensus.cc:2258] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:17.085556 22075 ts_tablet_manager.cc:1905] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:17.086845 22075 ts_tablet_manager.cc:1918] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:58:17.086905 22075 log.cc:1196] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/3e282a654c0e4fe0a551e97d4817b597
I20260811 18:58:17.087117 22075 ts_tablet_manager.cc:1939] T 3e282a654c0e4fe0a551e97d4817b597 P a6a5df1a57e344aba28d86bb3f278122: Deleting consensus metadata
I20260811 18:58:17.088316 21053 catalog_manager.cc:4841] TS a6a5df1a57e344aba28d86bb3f278122 (127.5.226.66:42923): tablet 3e282a654c0e4fe0a551e97d4817b597 (table test-table [id=28c1de5815bf4105a5e0cbc4bc9ab65f]) successfully deleted
I20260811 18:58:17.088475 22076 ts_tablet_manager.cc:1918] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:58:17.088534 22076 log.cc:1196] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/3e282a654c0e4fe0a551e97d4817b597
I20260811 18:58:17.088730 22076 ts_tablet_manager.cc:1939] T 3e282a654c0e4fe0a551e97d4817b597 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Deleting consensus metadata
I20260811 18:58:17.089015 21055 catalog_manager.cc:4841] TS 9dc94c704ce548dfbb3d3f839fb6e8d5 (127.5.226.67:42705): tablet 3e282a654c0e4fe0a551e97d4817b597 (table test-table [id=28c1de5815bf4105a5e0cbc4bc9ab65f]) successfully deleted
I20260811 18:58:17.089205 21057 catalog_manager.cc:4841] TS ef460c8798a74a25b3e39691aea0a73b (127.5.226.65:34139): tablet 3e282a654c0e4fe0a551e97d4817b597 (table test-table [id=28c1de5815bf4105a5e0cbc4bc9ab65f]) successfully deleted
Aug 11 18:58:17 dist-test-slave-gjw7 krb5kdc[20997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:58:17 dist-test-slave-gjw7 krb5kdc[20997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:17 dist-test-slave-gjw7 krb5kdc[20997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:58:17.110181 21173 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:17.104409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37524 (local address 127.5.226.126:33873)
0811 18:58:17.104466 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:17.104469 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:17.104567 (+ 98us) server_negotiation.cc:407] Connection header received
0811 18:58:17.104620 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:17.104621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:17.104632 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:17.104698 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:17.105212 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.106054 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.106844 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.107154 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.107224 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.110112 (+ 2888us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37524: BlockingRecv error: recv got EOF from 127.0.0.1:37524 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 11 18:58:17 dist-test-slave-gjw7 krb5kdc[20997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM
I20260811 18:58:17.118237 21173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.111134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37532 (local address 127.5.226.126:33873)
0811 18:58:17.111184 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:17.111186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:17.111195 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:17.111257 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:17.111258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:17.111267 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:17.111332 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:17.111733 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.112450 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.113110 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.113499 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.113570 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.115746 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:17.115747 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:17.115747 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:17.115755 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:17.117158 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:17.117547 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:17.117548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:17.117549 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:17.117604 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:17.117772 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:17.117773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:17.117773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:17.117879 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:17.117967 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:17.118060 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 18:58:17.118134 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:58:17.119879 21088 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37532:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:58:17.120064 21088 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:58:17.121474 21335 tablet_service.cc:1467] Processing CreateTablet for tablet 6df98fe961904c439b60747bf2dc0335 (DEFAULT_TABLE table=test-table [id=de44e9c1fd944ad39b8f6010f3334e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:17.121474 21597 tablet_service.cc:1467] Processing CreateTablet for tablet 6df98fe961904c439b60747bf2dc0335 (DEFAULT_TABLE table=test-table [id=de44e9c1fd944ad39b8f6010f3334e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:17.121606 21597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6df98fe961904c439b60747bf2dc0335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:17.121608 21335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6df98fe961904c439b60747bf2dc0335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:17.122896 22031 tablet_bootstrap.cc:492] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b: Bootstrap starting.
I20260811 18:58:17.122910 22035 tablet_bootstrap.cc:492] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122: Bootstrap starting.
I20260811 18:58:17.122938 21863 tablet_service.cc:1467] Processing CreateTablet for tablet 6df98fe961904c439b60747bf2dc0335 (DEFAULT_TABLE table=test-table [id=de44e9c1fd944ad39b8f6010f3334e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:17.123055 21863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6df98fe961904c439b60747bf2dc0335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:17.123231 22031 tablet_bootstrap.cc:654] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:17.123252 22035 tablet_bootstrap.cc:654] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:17.123745 22035 tablet_bootstrap.cc:492] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122: No bootstrap required, opened a new log
I20260811 18:58:17.123811 22035 ts_tablet_manager.cc:1397] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 18:58:17.123942 22035 raft_consensus.cc:348] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.124020 22035 raft_consensus.cc:374] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:17.124042 22035 raft_consensus.cc:729] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a5df1a57e344aba28d86bb3f278122, State: Initialized, Role: FOLLOWER
I20260811 18:58:17.124084 22035 consensus_queue.cc:260] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.124173 22035 ts_tablet_manager.cc:1428] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:17.124374 22039 tablet_bootstrap.cc:492] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Bootstrap starting.
I20260811 18:58:17.124770 22031 tablet_bootstrap.cc:492] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b: No bootstrap required, opened a new log
I20260811 18:58:17.124766 22039 tablet_bootstrap.cc:654] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:17.124811 22031 ts_tablet_manager.cc:1397] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:58:17.124943 22031 raft_consensus.cc:348] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.125007 22031 raft_consensus.cc:374] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:17.125034 22031 raft_consensus.cc:729] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef460c8798a74a25b3e39691aea0a73b, State: Initialized, Role: FOLLOWER
I20260811 18:58:17.125077 22031 consensus_queue.cc:260] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.125164 22031 ts_tablet_manager.cc:1428] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:17.125895 22039 tablet_bootstrap.cc:492] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5: No bootstrap required, opened a new log
I20260811 18:58:17.125950 22039 ts_tablet_manager.cc:1397] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260811 18:58:17.126109 22039 raft_consensus.cc:348] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.126191 22039 raft_consensus.cc:374] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:17.126222 22039 raft_consensus.cc:729] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dc94c704ce548dfbb3d3f839fb6e8d5, State: Initialized, Role: FOLLOWER
I20260811 18:58:17.126271 22039 consensus_queue.cc:260] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.126376 22039 ts_tablet_manager.cc:1428] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:17.139555 22044 raft_consensus.cc:482] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:17.139653 22044 raft_consensus.cc:504] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.140030 22044 leader_election.cc:288] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef460c8798a74a25b3e39691aea0a73b (127.5.226.65:34139), a6a5df1a57e344aba28d86bb3f278122 (127.5.226.66:42923)
I20260811 18:58:17.143549 22150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.140403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:57361 (local address 127.5.226.65:34139)
0811 18:58:17.140519 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:17.140520 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:17.140527 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:58:17.140551 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:17.140552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:17.140561 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:17.140623 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:17.140814 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.141391 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.142848 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.143223 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.143286 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.143296 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:17.143425 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 18:58:17.143464 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":67,"threads_started":1}
I20260811 18:58:17.143764 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.140252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:43227 (local address 127.5.226.66:42923)
0811 18:58:17.140301 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:17.140303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:17.140419 (+ 116us) server_negotiation.cc:407] Connection header received
0811 18:58:17.140523 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:17.140524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:17.140535 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:17.140573 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:17.140855 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.141592 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.142834 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.143370 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.143441 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.143450 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:17.143663 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 18:58:17.143697 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:58:17.144025 22149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.140185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:42923 (local address 127.5.226.67:43227)
0811 18:58:17.140358 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:17.140368 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:17.140448 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:17.140644 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:17.140645 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:17.140648 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:17.140760 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.140762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.141705 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.141706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.142737 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.142739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.143506 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.143507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.143584 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.143589 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:58:17.143890 (+ 301us) client_negotiation.cc:240] Negotiation successful
0811 18:58:17.143936 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":23,"thread_start_us":59,"threads_started":1}
I20260811 18:58:17.144035 22147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.140228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:34139 (local address 127.5.226.67:57361)
0811 18:58:17.140390 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:17.140400 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:17.140452 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:17.140642 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:17.140643 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:17.140646 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:17.140729 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.140731 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.141461 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.141462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.142730 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.142732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.143296 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.143297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.143365 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.143369 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:58:17.143414 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 18:58:17.143461 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":3,"thread_start_us":88,"threads_started":1}
I20260811 18:58:17.144299 21631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6df98fe961904c439b60747bf2dc0335" candidate_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a5df1a57e344aba28d86bb3f278122" is_pre_election: true
I20260811 18:58:17.144436 21631 raft_consensus.cc:2454] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dc94c704ce548dfbb3d3f839fb6e8d5 in term 0.
I20260811 18:58:17.144593 21382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6df98fe961904c439b60747bf2dc0335" candidate_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef460c8798a74a25b3e39691aea0a73b" is_pre_election: true
I20260811 18:58:17.144613 21763 leader_election.cc:302] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dc94c704ce548dfbb3d3f839fb6e8d5, a6a5df1a57e344aba28d86bb3f278122; no voters:
I20260811 18:58:17.144668 21382 raft_consensus.cc:2454] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dc94c704ce548dfbb3d3f839fb6e8d5 in term 0.
I20260811 18:58:17.144735 22044 raft_consensus.cc:2781] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:58:17.144776 22044 raft_consensus.cc:482] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:17.144804 22044 raft_consensus.cc:3037] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:17.145674 22044 raft_consensus.cc:504] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.145818 22044 leader_election.cc:288] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [CANDIDATE]: Term 1 election: Requested vote from peers ef460c8798a74a25b3e39691aea0a73b (127.5.226.65:34139), a6a5df1a57e344aba28d86bb3f278122 (127.5.226.66:42923)
I20260811 18:58:17.145961 21382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6df98fe961904c439b60747bf2dc0335" candidate_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef460c8798a74a25b3e39691aea0a73b"
I20260811 18:58:17.146037 21382 raft_consensus.cc:3037] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:17.146770 21382 raft_consensus.cc:2454] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dc94c704ce548dfbb3d3f839fb6e8d5 in term 1.
I20260811 18:58:17.146953 21631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6df98fe961904c439b60747bf2dc0335" candidate_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a5df1a57e344aba28d86bb3f278122"
I20260811 18:58:17.147017 21773 leader_election.cc:302] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dc94c704ce548dfbb3d3f839fb6e8d5, ef460c8798a74a25b3e39691aea0a73b; no voters:
I20260811 18:58:17.147037 21631 raft_consensus.cc:3037] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:17.147110 22044 raft_consensus.cc:2781] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:17.147250 22044 raft_consensus.cc:686] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 LEADER]: Becoming Leader. State: Replica: 9dc94c704ce548dfbb3d3f839fb6e8d5, State: Running, Role: LEADER
I20260811 18:58:17.147310 22044 consensus_queue.cc:237] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.147696 21631 raft_consensus.cc:2454] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dc94c704ce548dfbb3d3f839fb6e8d5 in term 1.
I20260811 18:58:17.148069 21091 catalog_manager.cc:5495] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dc94c704ce548dfbb3d3f839fb6e8d5 (127.5.226.67). New cstate: current_term: 1 leader_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } health_report { overall_health: HEALTHY } } }
I20260811 18:58:17.156239 22158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.153123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52412 (local address 127.5.226.67:42705)
0811 18:58:17.153362 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:17.153364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:17.153372 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:58:17.153413 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:17.153414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:17.153434 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:17.153509 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:17.153717 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.154254 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.155356 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.155568 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.155627 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.155846 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:17.155976 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:17.156041 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:17.156106 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 18:58:17.156124 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":103,"threads_started":1}
I20260811 18:58:17.157264 21382 raft_consensus.cc:1261] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Refusing update from remote peer 9dc94c704ce548dfbb3d3f839fb6e8d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:17.157490 21631 raft_consensus.cc:1261] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Refusing update from remote peer 9dc94c704ce548dfbb3d3f839fb6e8d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:17.157549 22151 consensus_queue.cc:1035] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:17.157725 22044 consensus_queue.cc:1035] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:17.161175 21091 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37532:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:17.161262 21091 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37532:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:17.161844 21091 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f: Sending DeleteTablet for 3 replicas of tablet 6df98fe961904c439b60747bf2dc0335
I20260811 18:58:17.162086 21597 tablet_service.cc:1514] Processing DeleteTablet for tablet 6df98fe961904c439b60747bf2dc0335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:17 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:45750
I20260811 18:58:17.162171 22075 tablet_replica.cc:330] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122: stopping tablet replica
I20260811 18:58:17.162170 21863 tablet_service.cc:1514] Processing DeleteTablet for tablet 6df98fe961904c439b60747bf2dc0335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:17 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:52404
I20260811 18:58:17.162220 22075 raft_consensus.cc:2229] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:17.162253 22076 tablet_replica.cc:330] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5: stopping tablet replica
I20260811 18:58:17.162257 22075 raft_consensus.cc:2258] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:17.162299 22076 raft_consensus.cc:2229] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:58:17.162377 22076 raft_consensus.cc:2258] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:17.162573 22075 ts_tablet_manager.cc:1905] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:17.162601 21335 tablet_service.cc:1514] Processing DeleteTablet for tablet 6df98fe961904c439b60747bf2dc0335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:17 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:42674
I20260811 18:58:17.162686 22079 tablet_replica.cc:330] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b: stopping tablet replica
I20260811 18:58:17.162734 22079 raft_consensus.cc:2229] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:17.162768 22079 raft_consensus.cc:2258] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:17.163028 22079 ts_tablet_manager.cc:1905] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:17.164062 22075 ts_tablet_manager.cc:1918] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:17.164112 22075 log.cc:1196] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/6df98fe961904c439b60747bf2dc0335
I20260811 18:58:17.164311 22075 ts_tablet_manager.cc:1939] T 6df98fe961904c439b60747bf2dc0335 P a6a5df1a57e344aba28d86bb3f278122: Deleting consensus metadata
I20260811 18:58:17.164391 22079 ts_tablet_manager.cc:1918] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:17.164436 22079 log.cc:1196] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-0/wal/wals/6df98fe961904c439b60747bf2dc0335
I20260811 18:58:17.164605 22079 ts_tablet_manager.cc:1939] T 6df98fe961904c439b60747bf2dc0335 P ef460c8798a74a25b3e39691aea0a73b: Deleting consensus metadata
I20260811 18:58:17.164929 22076 ts_tablet_manager.cc:1905] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:17.164996 21091 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37532:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:58:17.165143 21091 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:58:17.165551 21057 catalog_manager.cc:4841] TS ef460c8798a74a25b3e39691aea0a73b (127.5.226.65:34139): tablet 6df98fe961904c439b60747bf2dc0335 (table test-table [id=de44e9c1fd944ad39b8f6010f3334e14]) successfully deleted
I20260811 18:58:17.166685 22076 ts_tablet_manager.cc:1918] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:17.166743 22076 log.cc:1196] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/6df98fe961904c439b60747bf2dc0335
I20260811 18:58:17.166920 22076 ts_tablet_manager.cc:1939] T 6df98fe961904c439b60747bf2dc0335 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Deleting consensus metadata
I20260811 18:58:17.167258 21055 catalog_manager.cc:4841] TS 9dc94c704ce548dfbb3d3f839fb6e8d5 (127.5.226.67:42705): tablet 6df98fe961904c439b60747bf2dc0335 (table test-table [id=de44e9c1fd944ad39b8f6010f3334e14]) successfully deleted
I20260811 18:58:17.167258 21053 catalog_manager.cc:4841] TS a6a5df1a57e344aba28d86bb3f278122 (127.5.226.66:42923): tablet 6df98fe961904c439b60747bf2dc0335 (table test-table [id=de44e9c1fd944ad39b8f6010f3334e14]) successfully deleted
I20260811 18:58:17.168048 21335 tablet_service.cc:1467] Processing CreateTablet for tablet 30554ee516e24d59aa37e7b43a8cdfb6 (DEFAULT_TABLE table=test-table [id=a64d98ff75404525885f0e8271fa5572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:17.168071 21597 tablet_service.cc:1467] Processing CreateTablet for tablet 30554ee516e24d59aa37e7b43a8cdfb6 (DEFAULT_TABLE table=test-table [id=a64d98ff75404525885f0e8271fa5572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:17.168154 21597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30554ee516e24d59aa37e7b43a8cdfb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:17.168154 21335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30554ee516e24d59aa37e7b43a8cdfb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:17.169276 22035 tablet_bootstrap.cc:492] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122: Bootstrap starting.
I20260811 18:58:17.169282 22031 tablet_bootstrap.cc:492] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b: Bootstrap starting.
I20260811 18:58:17.169799 22035 tablet_bootstrap.cc:654] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:17.169931 22031 tablet_bootstrap.cc:654] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:17.170426 21863 tablet_service.cc:1467] Processing CreateTablet for tablet 30554ee516e24d59aa37e7b43a8cdfb6 (DEFAULT_TABLE table=test-table [id=a64d98ff75404525885f0e8271fa5572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:17.170529 21863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30554ee516e24d59aa37e7b43a8cdfb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:17.171478 22039 tablet_bootstrap.cc:492] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Bootstrap starting.
I20260811 18:58:17.171854 22039 tablet_bootstrap.cc:654] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:17.172026 22035 tablet_bootstrap.cc:492] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122: No bootstrap required, opened a new log
I20260811 18:58:17.172067 22035 ts_tablet_manager.cc:1397] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 18:58:17.172212 22035 raft_consensus.cc:348] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.172297 22035 raft_consensus.cc:374] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:17.172320 22035 raft_consensus.cc:729] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a5df1a57e344aba28d86bb3f278122, State: Initialized, Role: FOLLOWER
I20260811 18:58:17.172359 22035 consensus_queue.cc:260] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.172456 22035 ts_tablet_manager.cc:1428] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:17.172839 22031 tablet_bootstrap.cc:492] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b: No bootstrap required, opened a new log
I20260811 18:58:17.172887 22031 ts_tablet_manager.cc:1397] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 18:58:17.173034 22031 raft_consensus.cc:348] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.173110 22031 raft_consensus.cc:374] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:17.173134 22031 raft_consensus.cc:729] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef460c8798a74a25b3e39691aea0a73b, State: Initialized, Role: FOLLOWER
I20260811 18:58:17.173170 22031 consensus_queue.cc:260] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.173257 22031 ts_tablet_manager.cc:1428] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:17.173568 22039 tablet_bootstrap.cc:492] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5: No bootstrap required, opened a new log
I20260811 18:58:17.173617 22039 ts_tablet_manager.cc:1397] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260811 18:58:17.173761 22039 raft_consensus.cc:348] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.173818 22039 raft_consensus.cc:374] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:17.173846 22039 raft_consensus.cc:729] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dc94c704ce548dfbb3d3f839fb6e8d5, State: Initialized, Role: FOLLOWER
I20260811 18:58:17.173888 22039 consensus_queue.cc:260] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.173974 22039 ts_tablet_manager.cc:1428] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:17.196656 22041 raft_consensus.cc:482] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:17.196770 22041 raft_consensus.cc:504] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.197130 22041 leader_election.cc:288] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a5df1a57e344aba28d86bb3f278122 (127.5.226.66:42923), 9dc94c704ce548dfbb3d3f839fb6e8d5 (127.5.226.67:42705)
I20260811 18:58:17.200754 22158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.197370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:52573 (local address 127.5.226.67:42705)
0811 18:58:17.197483 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:17.197485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:17.197649 (+ 164us) server_negotiation.cc:407] Connection header received
0811 18:58:17.197760 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:17.197761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:17.197784 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:17.197832 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:17.197977 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.198767 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.199992 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.200374 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.200437 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.200448 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:17.200630 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 18:58:17.200679 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 18:58:17.200759 22174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.197319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:42705 (local address 127.5.226.65:52573)
0811 18:58:17.197558 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:17.197587 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:17.197682 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:17.197839 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:17.197841 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:17.197842 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:17.197916 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.197918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.198853 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.198854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.199923 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.199926 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.200446 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.200446 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.200523 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.200528 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:58:17.200606 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 18:58:17.200652 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":61,"threads_started":1}
I20260811 18:58:17.200835 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.197424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:41265 (local address 127.5.226.66:42923)
0811 18:58:17.197494 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:17.197496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:17.197728 (+ 232us) server_negotiation.cc:407] Connection header received
0811 18:58:17.197821 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:17.197823 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:17.197831 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:17.197878 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:17.198028 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.198504 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.199886 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.200481 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.200555 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.200563 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:17.200730 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 18:58:17.200779 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 18:58:17.201037 22175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.197319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:42923 (local address 127.5.226.65:41265)
0811 18:58:17.197652 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:17.197662 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:17.197759 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:17.197891 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:17.197892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:17.197893 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:17.197943 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.197944 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.198598 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.198599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.199797 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.199800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.200577 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.200578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.200640 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.200642 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:58:17.200912 (+ 270us) client_negotiation.cc:240] Negotiation successful
0811 18:58:17.200958 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":179,"thread_start_us":107,"threads_started":1}
I20260811 18:58:17.201165 21899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30554ee516e24d59aa37e7b43a8cdfb6" candidate_uuid: "ef460c8798a74a25b3e39691aea0a73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" is_pre_election: true
I20260811 18:58:17.201256 21899 raft_consensus.cc:2454] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef460c8798a74a25b3e39691aea0a73b in term 0.
I20260811 18:58:17.201270 21631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30554ee516e24d59aa37e7b43a8cdfb6" candidate_uuid: "ef460c8798a74a25b3e39691aea0a73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a5df1a57e344aba28d86bb3f278122" is_pre_election: true
I20260811 18:58:17.201387 21631 raft_consensus.cc:2454] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef460c8798a74a25b3e39691aea0a73b in term 0.
I20260811 18:58:17.201467 21246 leader_election.cc:302] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dc94c704ce548dfbb3d3f839fb6e8d5, ef460c8798a74a25b3e39691aea0a73b; no voters:
I20260811 18:58:17.201614 22041 raft_consensus.cc:2781] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:58:17.201670 22041 raft_consensus.cc:482] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:17.201689 22041 raft_consensus.cc:3037] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:17.202570 22041 raft_consensus.cc:504] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.202709 22041 leader_election.cc:288] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [CANDIDATE]: Term 1 election: Requested vote from peers a6a5df1a57e344aba28d86bb3f278122 (127.5.226.66:42923), 9dc94c704ce548dfbb3d3f839fb6e8d5 (127.5.226.67:42705)
I20260811 18:58:17.202857 21899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30554ee516e24d59aa37e7b43a8cdfb6" candidate_uuid: "ef460c8798a74a25b3e39691aea0a73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5"
I20260811 18:58:17.202908 21631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30554ee516e24d59aa37e7b43a8cdfb6" candidate_uuid: "ef460c8798a74a25b3e39691aea0a73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a5df1a57e344aba28d86bb3f278122"
I20260811 18:58:17.202950 21899 raft_consensus.cc:3037] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:17.202976 21631 raft_consensus.cc:3037] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:17.203729 21631 raft_consensus.cc:2454] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef460c8798a74a25b3e39691aea0a73b in term 1.
I20260811 18:58:17.203729 21899 raft_consensus.cc:2454] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef460c8798a74a25b3e39691aea0a73b in term 1.
I20260811 18:58:17.203894 21246 leader_election.cc:302] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dc94c704ce548dfbb3d3f839fb6e8d5, ef460c8798a74a25b3e39691aea0a73b; no voters:
I20260811 18:58:17.204005 22041 raft_consensus.cc:2781] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:17.204161 22041 raft_consensus.cc:686] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [term 1 LEADER]: Becoming Leader. State: Replica: ef460c8798a74a25b3e39691aea0a73b, State: Running, Role: LEADER
I20260811 18:58:17.204255 22041 consensus_queue.cc:237] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } }
I20260811 18:58:17.205000 21091 catalog_manager.cc:5495] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b reported cstate change: term changed from 0 to 1, leader changed from <none> to ef460c8798a74a25b3e39691aea0a73b (127.5.226.65). New cstate: current_term: 1 leader_uuid: "ef460c8798a74a25b3e39691aea0a73b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef460c8798a74a25b3e39691aea0a73b" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260811 18:58:17.221515 22150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.218949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42678 (local address 127.5.226.65:34139)
0811 18:58:17.218989 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:17.218991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:17.218999 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:58:17.219078 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:17.219079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:17.219104 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:17.219169 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:17.219275 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.219847 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.220607 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.220852 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.220904 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.221094 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:17.221262 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:17.221390 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:17.221409 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 18:58:17.221436 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:58:17.226779 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.224189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:56593 (local address 127.5.226.66:42923)
0811 18:58:17.224237 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:17.224239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:17.224358 (+ 119us) server_negotiation.cc:407] Connection header received
0811 18:58:17.224422 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:17.224423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:17.224431 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:17.224466 (+ 35us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:17.224620 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.225117 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.226142 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.226361 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.226413 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.226585 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:17.226610 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:17.226642 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:17.226702 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 18:58:17.226721 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:58:17.226832 22184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.224131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:42923 (local address 127.5.226.65:56593)
0811 18:58:17.224298 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:17.224308 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:17.224362 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:17.224483 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:17.224483 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:17.224485 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:58:17.224567 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.224569 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.225186 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.225187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.226058 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.226061 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.226429 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.226430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.226497 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.226514 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:58:17.226661 (+ 147us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:58:17.226662 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 18:58:17.226701 (+ 39us) client_negotiation.cc:240] Negotiation successful
0811 18:58:17.226744 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":74,"threads_started":1}
I20260811 18:58:17.228808 21631 raft_consensus.cc:1261] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Refusing update from remote peer ef460c8798a74a25b3e39691aea0a73b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:17.228828 21899 raft_consensus.cc:1261] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Refusing update from remote peer ef460c8798a74a25b3e39691aea0a73b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:17.229075 22041 consensus_queue.cc:1035] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a5df1a57e344aba28d86bb3f278122" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:17.229243 22177 consensus_queue.cc:1035] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dc94c704ce548dfbb3d3f839fb6e8d5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:17.236707 22150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.234265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:47095 (local address 127.5.226.65:34139)
0811 18:58:17.234315 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:17.234317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:17.234323 (+ 6us) server_negotiation.cc:407] Connection header received
0811 18:58:17.234344 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:17.234345 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:17.234354 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:17.234399 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:17.234554 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.235237 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.235977 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.236247 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.236312 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.236481 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:17.236511 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:17.236563 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:17.236609 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 18:58:17.236632 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 18:58:17.236732 22113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.234094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:34139 (local address 127.5.226.66:47095)
0811 18:58:17.234137 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:17.234149 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:17.234190 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:17.234442 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:17.234444 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:17.234445 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:58:17.234484 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.234486 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.235332 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.235333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.235909 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:17.235912 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:17.236329 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:17.236330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:17.236394 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:17.236402 (+ 8us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:58:17.236565 (+ 163us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:58:17.236566 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 18:58:17.236607 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 18:58:17.236658 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 18:58:17.243772 21091 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37532:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:17.243891 21091 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37532:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:17.244542 21091 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7db3547b9ea475a818a1af1b3ccfa0f: Sending DeleteTablet for 3 replicas of tablet 30554ee516e24d59aa37e7b43a8cdfb6
I20260811 18:58:17.244810 21335 tablet_service.cc:1514] Processing DeleteTablet for tablet 30554ee516e24d59aa37e7b43a8cdfb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:17 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:42674
I20260811 18:58:17.244910 22079 tablet_replica.cc:330] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b: stopping tablet replica
I20260811 18:58:17.244951 22079 raft_consensus.cc:2229] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:58:17.245038 22079 raft_consensus.cc:2258] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:17.245366 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 21207
I20260811 18:58:17.245424 22079 ts_tablet_manager.cc:1905] T 30554ee516e24d59aa37e7b43a8cdfb6 P ef460c8798a74a25b3e39691aea0a73b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:17.260052 21863 tablet_service.cc:1514] Processing DeleteTablet for tablet 30554ee516e24d59aa37e7b43a8cdfb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:17 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:52404
I20260811 18:58:17.260203 22076 tablet_replica.cc:330] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5: stopping tablet replica
I20260811 18:58:17.260252 22076 raft_consensus.cc:2229] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:17.260296 22076 raft_consensus.cc:2258] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:17.260540 21597 tablet_service.cc:1514] Processing DeleteTablet for tablet 30554ee516e24d59aa37e7b43a8cdfb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:17 UTC) from {username='oryx', principal='oryx/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:45750
I20260811 18:58:17.260643 22075 tablet_replica.cc:330] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122: stopping tablet replica
I20260811 18:58:17.260685 22075 raft_consensus.cc:2229] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:17.260721 22075 raft_consensus.cc:2258] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:17.260792 22076 ts_tablet_manager.cc:1905] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:17.262516 22076 ts_tablet_manager.cc:1918] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:58:17.262588 22076 log.cc:1196] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/30554ee516e24d59aa37e7b43a8cdfb6
I20260811 18:58:17.262794 22076 ts_tablet_manager.cc:1939] T 30554ee516e24d59aa37e7b43a8cdfb6 P 9dc94c704ce548dfbb3d3f839fb6e8d5: Deleting consensus metadata
I20260811 18:58:17.263214 21055 catalog_manager.cc:4841] TS 9dc94c704ce548dfbb3d3f839fb6e8d5 (127.5.226.67:42705): tablet 30554ee516e24d59aa37e7b43a8cdfb6 (table test-table [id=a64d98ff75404525885f0e8271fa5572]) successfully deleted
I20260811 18:58:17.264652 22075 ts_tablet_manager.cc:1905] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:17.266280 22075 ts_tablet_manager.cc:1918] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:58:17.266350 22075 log.cc:1196] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/30554ee516e24d59aa37e7b43a8cdfb6
I20260811 18:58:17.266558 22075 ts_tablet_manager.cc:1939] T 30554ee516e24d59aa37e7b43a8cdfb6 P a6a5df1a57e344aba28d86bb3f278122: Deleting consensus metadata
I20260811 18:58:17.266988 21053 catalog_manager.cc:4841] TS a6a5df1a57e344aba28d86bb3f278122 (127.5.226.66:42923): tablet 30554ee516e24d59aa37e7b43a8cdfb6 (table test-table [id=a64d98ff75404525885f0e8271fa5572]) successfully deleted
W20260811 18:58:17.272585 21057 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:34139 (error 108)
I20260811 18:58:17.273144 22194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:17.272948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:34139 (local address 127.0.0.1:42684)
0811 18:58:17.273050 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:17.273098 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:34139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":39,"threads_started":1}
I20260811 18:58:17.273142 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 21473
W20260811 18:58:17.286021 21057 catalog_manager.cc:4584] TS ef460c8798a74a25b3e39691aea0a73b (127.5.226.65:34139): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 30554ee516e24d59aa37e7b43a8cdfb6: Network error: Client connection negotiation failed: client connection to 127.5.226.65:34139: connect: Connection refused (error 111)
I20260811 18:58:17.291518 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 21727
I20260811 18:58:17.306048 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 21022
2026-08-11T18:58:17Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2939 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:58:17 dist-test-slave-gjw7 krb5kdc[22198](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:58:17 dist-test-slave-gjw7 krb5kdc[22198](info): set up 2 sockets
Aug 11 18:58:17 dist-test-slave-gjw7 krb5kdc[22198](info): commencing operation
krb5kdc: starting...
W20260811 18:58:18.524662 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:58:18 dist-test-slave-gjw7 krb5kdc[22198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474698, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:58:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 18:58:18.652580 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:39177
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:39177
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:18.736553 22220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:18.736771 22220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:18.736801 22220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:18.738046 22220 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:18.738098 22220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:18.738118 22220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:18.738134 22220 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:18.738150 22220 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:18.739790 22220 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:39177
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:39177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:18.740049 22220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:18.740265 22220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:18.745047 22234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:18.745054 22237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:18.745038 22230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:18.745405 22220 server_base.cc:1034] running on GCE node
I20260811 18:58:18.745680 22220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:18.745972 22220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:18.747126 22220 hybrid_clock.cc:648] HybridClock initialized: now 1786474698747113 us; error 29 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T18:58:18Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1442 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:58:18 dist-test-slave-gjw7 krb5kdc[22249](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:58:18 dist-test-slave-gjw7 krb5kdc[22249](info): set up 2 sockets
Aug 11 18:58:18 dist-test-slave-gjw7 krb5kdc[22249](info): commencing operation
krb5kdc: starting...
W20260811 18:58:19.989436 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:58:20 dist-test-slave-gjw7 krb5kdc[22249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:58:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 18:58:20.130216 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:33055
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:36837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:33055
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:20.217154 22286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:20.217443 22286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:20.217481 22286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:20.218691 22286 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:20.218732 22286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:20.218751 22286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:20.218767 22286 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:20.218782 22286 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:20.220319 22286 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:36837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:33055
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:33055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:20.220585 22286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:20.220803 22286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:20.225769 22293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:20.225865 22286 server_base.cc:1034] running on GCE node
W20260811 18:58:20.225818 22299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:20.225785 22295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:20.226378 22286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:20.226679 22286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:20.227833 22286 hybrid_clock.cc:648] HybridClock initialized: now 1786474700227814 us; error 28 us; skew 500 ppm
Aug 11 18:58:20 dist-test-slave-gjw7 krb5kdc[22249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474700, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:20.230403 22286 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 18:58:20.230913 22286 webserver.cc:460] Webserver started at http://127.5.226.126:36875/ using document root <none> and password file <none>
I20260811 18:58:20.231153 22286 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:20.231207 22286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:20.231346 22286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:20.232478 22286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "9b17687b0de04202a9a645b2bb82831a"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "932352c71892c1752da9c0abba9cb8f6"
server_key_iv: "27f06e346183c1e98f67b9670d6415db"
server_key_version: "encryptionkey@0"
I20260811 18:58:20.232841 22286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "9b17687b0de04202a9a645b2bb82831a"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "932352c71892c1752da9c0abba9cb8f6"
server_key_iv: "27f06e346183c1e98f67b9670d6415db"
server_key_version: "encryptionkey@0"
I20260811 18:58:20.234360 22286 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:58:20.235069 22310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:20.235219 22286 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:20.235335 22286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "9b17687b0de04202a9a645b2bb82831a"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "932352c71892c1752da9c0abba9cb8f6"
server_key_iv: "27f06e346183c1e98f67b9670d6415db"
server_key_version: "encryptionkey@0"
I20260811 18:58:20.235400 22286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:20.253592 22286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:20.255504 22286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:20.255661 22286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:20.260115 22286 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:33055
I20260811 18:58:20.260157 22409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:33055 every 8 connection(s)
I20260811 18:58:20.260519 22286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:20.261466 22411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:20.263926 22411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a: Bootstrap starting.
I20260811 18:58:20.264572 22411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:20.264854 22411 log.cc:824] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:20.265625 22411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a: No bootstrap required, opened a new log
I20260811 18:58:20.266407 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 22286
I20260811 18:58:20.266515 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:58:20.266695 6025 external_mini_cluster.cc:1428] Setting key b90978ed32b8eb5f0783ea8190b692dc
I20260811 18:58:20.267670 22411 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b17687b0de04202a9a645b2bb82831a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33055 } }
I20260811 18:58:20.267856 22411 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:20.267904 22411 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b17687b0de04202a9a645b2bb82831a, State: Initialized, Role: FOLLOWER
I20260811 18:58:20.268045 22411 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b17687b0de04202a9a645b2bb82831a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33055 } }
I20260811 18:58:20.268131 22411 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:20.268162 22411 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:20.268245 22411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:20.268921 22411 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b17687b0de04202a9a645b2bb82831a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33055 } }
I20260811 18:58:20.269035 22411 leader_election.cc:302] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b17687b0de04202a9a645b2bb82831a; no voters:
I20260811 18:58:20.269192 22411 leader_election.cc:288] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:20.269233 22418 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:20.269474 22418 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 1 LEADER]: Becoming Leader. State: Replica: 9b17687b0de04202a9a645b2bb82831a, State: Running, Role: LEADER
I20260811 18:58:20.269493 22411 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:20.269624 22418 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b17687b0de04202a9a645b2bb82831a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33055 } }
I20260811 18:58:20.270049 22419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b17687b0de04202a9a645b2bb82831a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b17687b0de04202a9a645b2bb82831a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33055 } } }
I20260811 18:58:20.270139 22419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:20.270285 22420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b17687b0de04202a9a645b2bb82831a. Latest consensus state: current_term: 1 leader_uuid: "9b17687b0de04202a9a645b2bb82831a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b17687b0de04202a9a645b2bb82831a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33055 } } }
I20260811 18:58:20.270357 22420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:20.270469 22433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:20.271159 22433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:20.272855 22433 catalog_manager.cc:1347] Generated new cluster ID: 2b7f595569944a1e9fd918044b80593e
I20260811 18:58:20.272910 22433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:58:20 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:20.279651 22417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:20.267291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40422 (local address 127.5.226.126:33055)
0811 18:58:20.267552 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:20.267563 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:20.267604 (+ 41us) server_negotiation.cc:407] Connection header received
0811 18:58:20.267732 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:20.267739 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:20.267821 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:20.267970 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:20.268741 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:20.270217 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:20.271344 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:20.271886 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:20.271984 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:20.275564 (+ 3580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:20.275569 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:20.275570 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:20.275584 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:20.277924 (+ 2340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:20.278318 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:20.278323 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:20.278323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:20.278434 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:20.278623 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:20.278624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:20.278624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:20.278920 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:20.279086 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:20.279206 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 18:58:20.279464 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":108,"threads_started":1}
I20260811 18:58:20.296137 22433 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:20.296697 22433 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:20.311853 22433 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a: Generated new TSK 0
I20260811 18:58:20.312053 22433 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 18:58:20.350474 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33055
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:36837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:20.460736 22457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:20.461004 22457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:20.461035 22457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:20.462237 22457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:20.462283 22457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:20.462311 22457 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:58:20.463770 22457 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:36837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:20.463987 22457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:20.464197 22457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:20.469172 22469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:20.469489 22457 server_base.cc:1034] running on GCE node
W20260811 18:58:20.469198 22466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:20.469172 22471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:20.469870 22457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:20.470132 22457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:20.471287 22457 hybrid_clock.cc:648] HybridClock initialized: now 1786474700471277 us; error 29 us; skew 500 ppm
Aug 11 18:58:20 dist-test-slave-gjw7 krb5kdc[22249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474700, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:20.473860 22457 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 18:58:20.474318 22457 webserver.cc:460] Webserver started at http://127.5.226.65:45025/ using document root <none> and password file <none>
I20260811 18:58:20.474519 22457 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:20.474565 22457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:20.474694 22457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:20.475769 22457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "69ba7e5cef664946b2f219b0f794daa3"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "3949137ab96a17d19642667b64d4d086"
server_key_iv: "ec7651d3a92458015d3babd98f642b81"
server_key_version: "encryptionkey@0"
I20260811 18:58:20.476133 22457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "69ba7e5cef664946b2f219b0f794daa3"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "3949137ab96a17d19642667b64d4d086"
server_key_iv: "ec7651d3a92458015d3babd98f642b81"
server_key_version: "encryptionkey@0"
I20260811 18:58:20.477540 22457 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:58:20.478287 22493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:20.478436 22457 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:20.478524 22457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "69ba7e5cef664946b2f219b0f794daa3"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "3949137ab96a17d19642667b64d4d086"
server_key_iv: "ec7651d3a92458015d3babd98f642b81"
server_key_version: "encryptionkey@0"
I20260811 18:58:20.478587 22457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:20.499416 22457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:20.501674 22457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:20.501824 22457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:20.502060 22457 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:20.502372 22457 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:20.502406 22457 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:20.502435 22457 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:20.502458 22457 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:20.508224 22457 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:42635
I20260811 18:58:20.508296 22720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:42635 every 8 connection(s)
I20260811 18:58:20.508589 22457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
Aug 11 18:58:20 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474700, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:20.517442 22417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:20.509332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:41223 (local address 127.5.226.126:33055)
0811 18:58:20.509403 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:20.509405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:20.509594 (+ 189us) server_negotiation.cc:407] Connection header received
0811 18:58:20.510148 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:20.510149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:20.510167 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:20.510221 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:20.511243 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:20.511748 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:20.512738 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:20.512941 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:20.512999 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:20.515153 (+ 2154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:20.515155 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:20.515155 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:20.515162 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:20.516288 (+ 1126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:20.516638 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:20.516639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:20.516640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:20.516691 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:20.516889 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:20.516889 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:20.516889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:20.516989 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:20.517034 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:20.517270 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 18:58:20.517374 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 18:58:20.517673 22725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:20.509254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:41223)
0811 18:58:20.509468 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:20.509510 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:20.510040 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:20.510341 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:20.510345 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:20.510919 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:20.511135 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:20.511141 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:20.511836 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:20.511837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:20.512643 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:20.512645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:20.513012 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:20.513014 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:20.513146 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:20.513635 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:20.513643 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:20.515044 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:20.516356 (+ 1312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:20.516363 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:20.516365 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:20.516578 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:20.516755 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:20.516756 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:20.516756 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:20.516846 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:20.517038 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:20.517042 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:20.517161 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 18:58:20.517245 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 18:58:20.517422 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":112,"threads_started":1}
I20260811 18:58:20.517750 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 22457
I20260811 18:58:20.517855 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:58:20.518070 6025 external_mini_cluster.cc:1428] Setting key 1363395093403dfbbc684c514efefaac
I20260811 18:58:20.518247 22721 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33055
I20260811 18:58:20.518365 22721 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:20.518564 22721 heartbeater.cc:511] Master 127.5.226.126:33055 requested a full tablet report, sending...
I20260811 18:58:20.519080 22337 ts_manager.cc:194] Registered new tserver with Master: 69ba7e5cef664946b2f219b0f794daa3 (127.5.226.65:42635)
I20260811 18:58:20.519687 22337 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:41223
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 18:58:20.543699 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33055
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:36837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:20.627895 22729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:20.628109 22729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:20.628134 22729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:20.629313 22729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:20.629357 22729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:20.629383 22729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:58:20.630828 22729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:36837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:20.631026 22729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:20.631217 22729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:20.636215 22742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:20.636351 22729 server_base.cc:1034] running on GCE node
W20260811 18:58:20.636278 22740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:20.636215 22735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:20.636613 22729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:20.636852 22729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:20.637995 22729 hybrid_clock.cc:648] HybridClock initialized: now 1786474700637980 us; error 29 us; skew 500 ppm
Aug 11 18:58:20 dist-test-slave-gjw7 krb5kdc[22249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474700, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:20.640434 22729 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 18:58:20.640892 22729 webserver.cc:460] Webserver started at http://127.5.226.66:33767/ using document root <none> and password file <none>
I20260811 18:58:20.641100 22729 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:20.641147 22729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:20.641276 22729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:20.642361 22729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "27132d338be744eeabf9da607be1aaca"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "9283775a8b6e20c68cc52cc95bb01d4c"
server_key_iv: "2e5212f4030aaee0f72d0cd1450d9984"
server_key_version: "encryptionkey@0"
I20260811 18:58:20.642716 22729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "27132d338be744eeabf9da607be1aaca"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "9283775a8b6e20c68cc52cc95bb01d4c"
server_key_iv: "2e5212f4030aaee0f72d0cd1450d9984"
server_key_version: "encryptionkey@0"
I20260811 18:58:20.644023 22729 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:58:20.644753 22755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:20.644907 22729 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:20.645004 22729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "27132d338be744eeabf9da607be1aaca"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "9283775a8b6e20c68cc52cc95bb01d4c"
server_key_iv: "2e5212f4030aaee0f72d0cd1450d9984"
server_key_version: "encryptionkey@0"
I20260811 18:58:20.645073 22729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:20.661895 22729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:20.664011 22729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:20.664149 22729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:20.664387 22729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:20.664713 22729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:20.664750 22729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:20.664779 22729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:20.664803 22729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:20.670774 22729 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:38387
I20260811 18:58:20.670859 22981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:38387 every 8 connection(s)
I20260811 18:58:20.671171 22729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
Aug 11 18:58:20 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474700, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:20.679304 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 22729
I20260811 18:58:20.679450 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:58:20.679682 6025 external_mini_cluster.cc:1428] Setting key b8a95d70a1440aeca6ef06e3719a3766
I20260811 18:58:20.680099 22417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:20.671934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:35587 (local address 127.5.226.126:33055)
0811 18:58:20.671992 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:20.671994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:20.672149 (+ 155us) server_negotiation.cc:407] Connection header received
0811 18:58:20.672651 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:20.672652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:20.672661 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:20.672736 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:20.673706 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:20.674229 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:20.675163 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:20.675378 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:20.675434 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:20.677579 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:20.677580 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:20.677580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:20.677588 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:20.678722 (+ 1134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:20.679093 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:20.679093 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:20.679094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:20.679144 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:20.679402 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:20.679403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:20.679403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:20.679537 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:20.679586 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:20.679932 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 18:58:20.680017 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 18:58:20.680260 22985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:20.671864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:35587)
0811 18:58:20.672030 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:20.672075 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:20.672568 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:20.672794 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:20.672798 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:20.673412 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:20.673620 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:20.673626 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:20.674298 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:20.674299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:20.675092 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:20.675094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:20.675449 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:20.675450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:20.675560 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:20.676088 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:20.676097 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:20.677490 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:20.678815 (+ 1325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:20.678827 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:20.678829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:20.679037 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:20.679194 (+ 157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:20.679195 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:20.679196 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:20.679332 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:20.679585 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:20.679593 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:20.679761 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 18:58:20.679882 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 18:58:20.680042 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":79,"threads_started":1}
I20260811 18:58:20.680665 22983 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33055
I20260811 18:58:20.680763 22983 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:20.680943 22983 heartbeater.cc:511] Master 127.5.226.126:33055 requested a full tablet report, sending...
I20260811 18:58:20.681371 22337 ts_manager.cc:194] Registered new tserver with Master: 27132d338be744eeabf9da607be1aaca (127.5.226.66:38387)
I20260811 18:58:20.681794 22337 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:35587
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 18:58:20.705330 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33055
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:36837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:20.788226 22990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:20.788425 22990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:20.788447 22990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:20.789654 22990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:20.789700 22990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:20.789724 22990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:58:20.791340 22990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:36837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:20.791569 22990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:20.791781 22990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:20.796674 23000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:20.796756 22990 server_base.cc:1034] running on GCE node
W20260811 18:58:20.796636 22999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:20.796657 23005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:20.797039 22990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:20.797250 22990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:20.798449 22990 hybrid_clock.cc:648] HybridClock initialized: now 1786474700798434 us; error 26 us; skew 500 ppm
Aug 11 18:58:20 dist-test-slave-gjw7 krb5kdc[22249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474700, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:20.801021 22990 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 18:58:20.801517 22990 webserver.cc:460] Webserver started at http://127.5.226.67:43821/ using document root <none> and password file <none>
I20260811 18:58:20.801740 22990 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:20.801795 22990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:20.801934 22990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:20.803028 22990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "87e676f8d2b9461b982ee4fe149b0034"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "fdd318da0be4fe8fb2f26d6ee9461837"
server_key_iv: "362b0b37ce9a03f7b6494c490c72a086"
server_key_version: "encryptionkey@0"
I20260811 18:58:20.803401 22990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "87e676f8d2b9461b982ee4fe149b0034"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "fdd318da0be4fe8fb2f26d6ee9461837"
server_key_iv: "362b0b37ce9a03f7b6494c490c72a086"
server_key_version: "encryptionkey@0"
I20260811 18:58:20.804764 22990 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:58:20.805588 23015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:20.805742 22990 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:20.805840 22990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "87e676f8d2b9461b982ee4fe149b0034"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "fdd318da0be4fe8fb2f26d6ee9461837"
server_key_iv: "362b0b37ce9a03f7b6494c490c72a086"
server_key_version: "encryptionkey@0"
I20260811 18:58:20.805908 22990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:20.826202 22990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:20.828317 22990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:20.828477 22990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:20.828745 22990 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:20.829092 22990 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:20.829133 22990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:20.829169 22990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:20.829190 22990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:20.835410 22990 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:35117
I20260811 18:58:20.835476 23215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:35117 every 8 connection(s)
I20260811 18:58:20.835826 22990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:20.840775 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 22990
I20260811 18:58:20.840878 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:58:20.841058 6025 external_mini_cluster.cc:1428] Setting key d7f932f021ced4a598d84744c36c321d
Aug 11 18:58:20 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474700, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:20.845824 22417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:20.836551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:38165 (local address 127.5.226.126:33055)
0811 18:58:20.836601 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:20.836602 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:20.836836 (+ 234us) server_negotiation.cc:407] Connection header received
0811 18:58:20.837355 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:20.837356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:20.837369 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:20.837436 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:20.838466 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:20.839024 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:20.840101 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:20.840316 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:20.840382 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:20.843005 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:20.843007 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:20.843007 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:20.843015 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:20.844263 (+ 1248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:20.844756 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:20.844757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:20.844758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:20.844836 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:20.845103 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:20.845104 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:20.845105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:20.845225 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:20.845320 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:20.845660 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 18:58:20.845740 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:58:20.846031 23218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:20.836515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:38165)
0811 18:58:20.836691 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:20.836734 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:20.837239 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:20.837503 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:20.837506 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:20.838147 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:20.838352 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:20.838358 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:20.839151 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:20.839152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:20.839996 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:20.840000 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:20.840393 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:20.840394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:20.840509 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:20.841170 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:20.841182 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:20.842897 (+ 1715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:20.844358 (+ 1461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:20.844368 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:20.844370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:20.844638 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:20.844909 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:20.844910 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:20.844910 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:20.845041 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:20.845351 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:20.845361 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:20.845529 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 18:58:20.845634 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 18:58:20.845790 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":87,"threads_started":1}
I20260811 18:58:20.846573 23216 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33055
I20260811 18:58:20.846675 23216 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:20.846875 23216 heartbeater.cc:511] Master 127.5.226.126:33055 requested a full tablet report, sending...
I20260811 18:58:20.847263 22337 ts_manager.cc:194] Registered new tserver with Master: 87e676f8d2b9461b982ee4fe149b0034 (127.5.226.67:35117)
I20260811 18:58:20.847653 22337 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:38165
I20260811 18:58:20.853015 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.65.keytab.
Entry for principal oryx/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.65.keytab.
WARNING: no policy specified for oryx/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.66.keytab.
Entry for principal oryx/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.66.keytab.
WARNING: no policy specified for oryx/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.67.keytab.
Entry for principal oryx/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.67.keytab.
I20260811 18:58:20.928385 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 22457
I20260811 18:58:20.940882 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 22729
I20260811 18:58:20.955814 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 22990
I20260811 18:58:20.982908 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 22286
I20260811 18:58:20.996517 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:33055
--webserver_interface=127.5.226.126
--webserver_port=36875
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:36837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:33055
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:21.077865 23230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:21.078074 23230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:21.078102 23230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:21.079208 23230 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:21.079257 23230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:21.079277 23230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:21.079293 23230 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:21.079308 23230 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:21.080919 23230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:36837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:33055
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:33055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=36875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:21.081230 23230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:21.081471 23230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:21.086145 23240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:21.086238 23244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:21.086334 23230 server_base.cc:1034] running on GCE node
W20260811 18:58:21.086244 23238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:21.086719 23230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:21.087018 23230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:21.088181 23230 hybrid_clock.cc:648] HybridClock initialized: now 1786474701088164 us; error 30 us; skew 500 ppm
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474701, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:21.090770 23230 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 18:58:21.091245 23230 webserver.cc:460] Webserver started at http://127.5.226.126:36875/ using document root <none> and password file <none>
I20260811 18:58:21.091449 23230 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:21.091518 23230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:21.092846 23230 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:21.093539 23256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:21.093700 23230 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:21.093796 23230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "9b17687b0de04202a9a645b2bb82831a"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "932352c71892c1752da9c0abba9cb8f6"
server_key_iv: "27f06e346183c1e98f67b9670d6415db"
server_key_version: "encryptionkey@0"
I20260811 18:58:21.094142 23230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:21.119915 23230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:21.122354 23230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:21.122510 23230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:21.126904 23230 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:33055
I20260811 18:58:21.126940 23355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:33055 every 8 connection(s)
I20260811 18:58:21.127379 23230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:21.128922 23356 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:58:21.129588 23356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a: Bootstrap starting.
I20260811 18:58:21.131687 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 23230
I20260811 18:58:21.132009 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:42635
--local_ip_for_outbound_sockets=127.5.226.65
--tserver_master_addrs=127.5.226.126:33055
--webserver_port=45025
--webserver_interface=127.5.226.65
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:36837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.5.226.65
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:58:21.138656 23356 log.cc:824] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:21.140314 23356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:58:21.140602 23356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a: Bootstrap complete.
I20260811 18:58:21.142880 23356 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b17687b0de04202a9a645b2bb82831a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33055 } }
I20260811 18:58:21.143112 23356 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b17687b0de04202a9a645b2bb82831a, State: Initialized, Role: FOLLOWER
I20260811 18:58:21.143262 23356 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b17687b0de04202a9a645b2bb82831a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33055 } }
I20260811 18:58:21.143332 23356 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:21.143364 23356 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:21.143409 23356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:58:21.144403 23356 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b17687b0de04202a9a645b2bb82831a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33055 } }
I20260811 18:58:21.144503 23356 leader_election.cc:302] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b17687b0de04202a9a645b2bb82831a; no voters:
I20260811 18:58:21.144676 23356 leader_election.cc:288] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 18:58:21.144727 23363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:58:21.144959 23363 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [term 2 LEADER]: Becoming Leader. State: Replica: 9b17687b0de04202a9a645b2bb82831a, State: Running, Role: LEADER
I20260811 18:58:21.144970 23356 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:21.145153 23363 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b17687b0de04202a9a645b2bb82831a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33055 } }
I20260811 18:58:21.145539 23364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9b17687b0de04202a9a645b2bb82831a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b17687b0de04202a9a645b2bb82831a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33055 } } }
I20260811 18:58:21.145550 23367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b17687b0de04202a9a645b2bb82831a. Latest consensus state: current_term: 2 leader_uuid: "9b17687b0de04202a9a645b2bb82831a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b17687b0de04202a9a645b2bb82831a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33055 } } }
I20260811 18:58:21.145643 23364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:21.145669 23367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:21.146256 23382 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:21.147027 23382 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:21.147210 23382 catalog_manager.cc:1259] Loaded cluster ID: 2b7f595569944a1e9fd918044b80593e
I20260811 18:58:21.147269 23382 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:21.148473 23382 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:21.148684 23382 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9b17687b0de04202a9a645b2bb82831a: Loaded TSK: 0
I20260811 18:58:21.148924 23382 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:58:21.218180 23358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:21.218389 23358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:21.218420 23358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:21.219573 23358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:21.219614 23358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:21.219648 23358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:58:21.221055 23358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:36837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.65.keytab
--principal=oryx/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:42635
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=45025
--tserver_master_addrs=127.5.226.126:33055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:21.221339 23358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:21.221557 23358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:21.226441 23400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:21.226449 23402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:21.226455 23408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:21.227025 23358 server_base.cc:1034] running on GCE node
I20260811 18:58:21.227270 23358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:21.227579 23358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:21.228899 23358 hybrid_clock.cc:648] HybridClock initialized: now 1786474701228872 us; error 41 us; skew 500 ppm
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474701, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:21.232003 23358 init.cc:377] Logged in from keytab as oryx/127.5.226.65@KRBTEST.COM (short username oryx)
I20260811 18:58:21.232532 23358 webserver.cc:460] Webserver started at http://127.5.226.65:45025/ using document root <none> and password file <none>
I20260811 18:58:21.232787 23358 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:21.232864 23358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:21.234648 23358 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:21.235342 23421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:21.235525 23358 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:21.235608 23358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "69ba7e5cef664946b2f219b0f794daa3"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "3949137ab96a17d19642667b64d4d086"
server_key_iv: "ec7651d3a92458015d3babd98f642b81"
server_key_version: "encryptionkey@0"
I20260811 18:58:21.235986 23358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:21.252866 23358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:21.255221 23358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:21.255347 23358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:21.255594 23358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:21.255932 23358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:21.255970 23358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:21.256001 23358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:21.256019 23358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:21.261803 23358 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:42635
I20260811 18:58:21.261866 23645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:42635 every 8 connection(s)
I20260811 18:58:21.262188 23358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 18:58:21.268275 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 23358
I20260811 18:58:21.268574 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:38387
--local_ip_for_outbound_sockets=127.5.226.66
--tserver_master_addrs=127.5.226.126:33055
--webserver_port=33767
--webserver_interface=127.5.226.66
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:36837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.5.226.66
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:21.271452 23649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:21.262928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:49997)
0811 18:58:21.263107 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:21.263155 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:21.263645 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:21.264206 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:21.264211 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:21.264955 (+ 744us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:21.265269 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.265278 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.266380 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.266381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.267601 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.267603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.268203 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.268204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.268328 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.268888 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:21.268897 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:21.271252 (+ 2355us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":86,"threads_started":1}
W20260811 18:58:21.271713 23646 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:33055 (0 consecutive failures): Not authorized: Failed to ping master at 127.5.226.126:33055: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
W20260811 18:58:21.271953 23650 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:21.262984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:49997 (local address 127.5.226.126:33055)
0811 18:58:21.263831 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:21.263839 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:21.263868 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:58:21.263969 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:21.263974 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:21.264012 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:21.264104 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:21.265434 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.266283 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.267697 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.268098 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.268203 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.271402 (+ 3199us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:49997: BlockingRecv error: recv got EOF from 127.5.226.65:49997 (error 108)
Metrics: {"server-negotiator.queue_time_us":799,"thread_start_us":80,"threads_started":1}
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:21.276384 23649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:21.271926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:38147)
0811 18:58:21.272129 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:21.272141 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:21.272193 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:21.272446 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:21.272447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:21.272576 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:21.272622 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.272624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.273240 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.273241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.273817 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.273820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.274184 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.274185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.274252 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.274635 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:21.274640 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:21.276318 (+ 1678us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188}
W20260811 18:58:21.276460 23650 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:21.272019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:38147 (local address 127.5.226.126:33055)
0811 18:58:21.272105 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:21.272107 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:21.272192 (+ 85us) server_negotiation.cc:407] Connection header received
0811 18:58:21.272369 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:21.272370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:21.272385 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:21.272434 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:21.272691 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.273168 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.273930 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.274124 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.274179 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.276406 (+ 2227us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:38147: BlockingRecv error: recv got EOF from 127.5.226.65:38147 (error 108)
Metrics: {"server-negotiator.queue_time_us":70,"thread_start_us":78,"threads_started":1}
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:21.281062 23649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:21.276755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:59017)
0811 18:58:21.276808 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:21.276820 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:21.276867 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:21.276995 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:21.276996 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:21.277130 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:21.277164 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.277166 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.277773 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.277775 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.278528 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.278531 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.278831 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.278832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.278887 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.279323 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:21.279329 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:21.281001 (+ 1672us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 18:58:21.281143 23650 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:21.276811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:59017 (local address 127.5.226.126:33055)
0811 18:58:21.276856 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:21.276858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:21.276866 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:58:21.276925 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:21.276926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:21.276934 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:21.276977 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:21.277235 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.277702 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.278600 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.278769 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.278811 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.281093 (+ 2282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:59017: BlockingRecv error: recv got EOF from 127.5.226.65:59017 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 18:58:21.281215 23646 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:58:21.353156 23651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:21.353372 23651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:21.353395 23651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:21.354529 23651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:21.354571 23651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:21.354596 23651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:58:21.356032 23651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:36837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.66.keytab
--principal=oryx/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:38387
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=33767
--tserver_master_addrs=127.5.226.126:33055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:21.356254 23651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:21.356465 23651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:21.361104 23672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:21.361114 23670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:21.361320 23651 server_base.cc:1034] running on GCE node
W20260811 18:58:21.361173 23662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:21.361618 23651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:21.361835 23651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:21.363051 23651 hybrid_clock.cc:648] HybridClock initialized: now 1786474701363035 us; error 27 us; skew 500 ppm
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474701, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:21.365530 23651 init.cc:377] Logged in from keytab as oryx/127.5.226.66@KRBTEST.COM (short username oryx)
I20260811 18:58:21.365967 23651 webserver.cc:460] Webserver started at http://127.5.226.66:33767/ using document root <none> and password file <none>
I20260811 18:58:21.366189 23651 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:21.366250 23651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:21.367527 23651 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:21.368105 23686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:21.368278 23651 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:21.368363 23651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "27132d338be744eeabf9da607be1aaca"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "9283775a8b6e20c68cc52cc95bb01d4c"
server_key_iv: "2e5212f4030aaee0f72d0cd1450d9984"
server_key_version: "encryptionkey@0"
I20260811 18:58:21.368688 23651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:21.380020 23651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:21.381879 23651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:21.382009 23651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:21.382220 23651 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:21.382540 23651 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:21.382575 23651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:21.382604 23651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:21.382627 23651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:21.388453 23651 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:38387
I20260811 18:58:21.388486 23907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:38387 every 8 connection(s)
I20260811 18:58:21.388931 23651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:21.395628 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 23651
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:21.395881 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:35117
--local_ip_for_outbound_sockets=127.5.226.67
--tserver_master_addrs=127.5.226.126:33055
--webserver_port=43821
--webserver_interface=127.5.226.67
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:36837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.5.226.67
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:21.396538 23650 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:21.390028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:40271 (local address 127.5.226.126:33055)
0811 18:58:21.390094 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:21.390097 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:21.390509 (+ 412us) server_negotiation.cc:407] Connection header received
0811 18:58:21.391106 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:21.391107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:21.391125 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:21.391176 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:21.392050 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.392551 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.393542 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.393722 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.393772 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.396482 (+ 2710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:40271: BlockingRecv error: recv got EOF from 127.5.226.66:40271 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 18:58:21.396580 23912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:21.389731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:40271)
0811 18:58:21.390374 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:21.390424 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:21.391013 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:21.391241 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:21.391244 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:21.391791 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:21.391982 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.391988 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.392615 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.392615 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.393475 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.393478 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.393779 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.393780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.393875 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.394332 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:21.394341 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:21.396390 (+ 2049us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":85,"threads_started":1}
W20260811 18:58:21.396927 23908 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:33055 (0 consecutive failures): Not authorized: Failed to ping master at 127.5.226.126:33055: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:21.401486 23912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:21.397160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:39703)
0811 18:58:21.397205 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:21.397215 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:21.397249 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:21.397415 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:21.397416 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:21.397561 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:21.397656 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.397658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.398445 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.398445 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.399002 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.399005 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.399330 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.399331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.399394 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.399752 (+ 358us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:21.399757 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:21.401423 (+ 1666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 18:58:21.401558 23650 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:21.397202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:39703 (local address 127.5.226.126:33055)
0811 18:58:21.397245 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:21.397247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:21.397256 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:21.397339 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:21.397340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:21.397349 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:21.397400 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:21.397723 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.398377 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.399079 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.399258 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.399315 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.401504 (+ 2189us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:39703: BlockingRecv error: recv got EOF from 127.5.226.66:39703 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:21.406396 23917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:21.401721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:40771)
0811 18:58:21.401902 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:21.401913 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:21.401969 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:21.402091 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:21.402092 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:21.402222 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:21.402275 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.402276 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.403133 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.403134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.403701 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.403703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.404151 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.404152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.404202 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.404631 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:21.404636 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:21.406336 (+ 1700us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":134,"threads_started":1}
W20260811 18:58:21.406507 23650 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:21.401773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:40771 (local address 127.5.226.126:33055)
0811 18:58:21.401806 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:21.401807 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:21.401979 (+ 172us) server_negotiation.cc:407] Connection header received
0811 18:58:21.402011 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:21.402012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:21.402024 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:21.402089 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:21.402357 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.403050 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.403775 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.404053 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.404120 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.406443 (+ 2323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:40771: BlockingRecv error: recv got EOF from 127.5.226.66:40771 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260811 18:58:21.406522 23908 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:58:21.481518 23914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:21.481736 23914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:21.481760 23914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:21.482901 23914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:21.482935 23914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:21.482960 23914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:58:21.484371 23914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:36837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/krb5kdc/oryx_127.5.226.67.keytab
--principal=oryx/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:35117
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=43821
--tserver_master_addrs=127.5.226.126:33055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:21.484557 23914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:21.484733 23914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:21.489545 23935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:21.489638 23929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:21.489770 23914 server_base.cc:1034] running on GCE node
W20260811 18:58:21.489813 23930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:21.490011 23914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:21.490254 23914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:21.491418 23914 hybrid_clock.cc:648] HybridClock initialized: now 1786474701491399 us; error 33 us; skew 500 ppm
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474701, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:21.493914 23914 init.cc:377] Logged in from keytab as oryx/127.5.226.67@KRBTEST.COM (short username oryx)
I20260811 18:58:21.494347 23914 webserver.cc:460] Webserver started at http://127.5.226.67:43821/ using document root <none> and password file <none>
I20260811 18:58:21.494549 23914 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:21.494609 23914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:21.495954 23914 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:21.496564 23945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:21.496752 23914 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:21.496846 23914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "87e676f8d2b9461b982ee4fe149b0034"
format_stamp: "Formatted at 2026-08-11 18:58:20 on dist-test-slave-gjw7"
server_key: "fdd318da0be4fe8fb2f26d6ee9461837"
server_key_iv: "362b0b37ce9a03f7b6494c490c72a086"
server_key_version: "encryptionkey@0"
I20260811 18:58:21.497222 23914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:21.511116 23914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:21.513070 23914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:21.513214 23914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:21.513455 23914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:21.513753 23914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:21.513789 23914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:21.513819 23914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:21.513842 23914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:21.519469 23914 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:35117
I20260811 18:58:21.519515 24169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:35117 every 8 connection(s)
I20260811 18:58:21.519855 23914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:21.522291 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 23914
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:58:21.527577 23650 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:21.520515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:40697 (local address 127.5.226.126:33055)
0811 18:58:21.520597 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:21.520600 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:21.520769 (+ 169us) server_negotiation.cc:407] Connection header received
0811 18:58:21.521349 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:21.521350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:21.521364 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:21.521431 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:21.522389 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.523009 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.524181 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.524397 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.524466 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.527530 (+ 3064us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:40697: BlockingRecv error: recv got EOF from 127.5.226.67:40697 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 18:58:21.527666 24175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:21.520493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:40697)
0811 18:58:21.520654 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:21.520690 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:21.521175 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:21.521523 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:21.521527 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:21.522084 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:21.522275 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.522280 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.523102 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.523104 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.524096 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.524099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.524478 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.524479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.524582 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.525069 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:21.525080 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:21.527457 (+ 2377us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":86,"threads_started":1}
W20260811 18:58:21.527906 24171 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:33055 (0 consecutive failures): Not authorized: Failed to ping master at 127.5.226.126:33055: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
I20260811 18:58:21.530030 23652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:21.522776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40430 (local address 127.5.226.126:33055)
0811 18:58:21.522838 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:21.522839 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:21.522873 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:58:21.522957 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:21.522958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:21.522967 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:21.523022 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:21.523630 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.524298 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.525041 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.525351 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.525418 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.526926 (+ 1508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:21.526932 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:21.526932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:21.526945 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:21.528680 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:21.529052 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:21.529054 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:21.529054 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:21.529140 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:21.529333 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:21.529334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:21.529335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:21.529614 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:21.529749 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:21.529835 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 18:58:21.529939 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:21.532694 24175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:21.528115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:42491)
0811 18:58:21.528249 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:21.528260 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:21.528308 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:21.528422 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:21.528423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:21.528543 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:21.528590 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.528591 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.529367 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.529368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.530082 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.530086 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.530605 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.530606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.530676 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.531066 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:21.531070 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:21.532635 (+ 1565us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114}
W20260811 18:58:21.532781 23650 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:21.528176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:42491 (local address 127.5.226.126:33055)
0811 18:58:21.528264 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:21.528266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:21.528294 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:58:21.528358 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:21.528359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:21.528369 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:21.528413 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:21.528654 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.529308 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.530271 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.530494 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.530554 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.532735 (+ 2181us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:42491: BlockingRecv error: recv got EOF from 127.5.226.67:42491 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:21 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:21.536514 24175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:21.532968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:38895)
0811 18:58:21.533009 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:21.533019 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:21.533055 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:21.533155 (+ 100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:21.533156 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:21.533280 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:21.533345 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.533347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.533896 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.533897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.534396 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:21.534397 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.534708 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.534708 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:21.534741 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.535030 (+ 289us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:21.535034 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:21.536471 (+ 1437us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 18:58:21.536600 23650 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:21.533021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:38895 (local address 127.5.226.126:33055)
0811 18:58:21.533062 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:21.533063 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:21.533071 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:58:21.533092 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:21.533093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:21.533101 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:21.533147 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:21.533400 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.533835 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.534468 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:21.534640 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:21.534707 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:21.536543 (+ 1836us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:38895: BlockingRecv error: recv got EOF from 127.5.226.67:38895 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 18:58:21.536669 24171 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 18:58:22 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:22 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:22.286053 24182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:22.281547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:36865)
0811 18:58:22.281677 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:22.281688 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:22.281746 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:22.281883 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:22.281884 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:22.282054 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:22.282104 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:22.282106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:22.282739 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:22.282741 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:22.283341 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:22.283344 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:22.283658 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:22.283660 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:22.283715 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:22.284125 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:22.284129 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:22.285962 (+ 1833us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
W20260811 18:58:22.286131 24183 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:22.281621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:36865 (local address 127.5.226.126:33055)
0811 18:58:22.281725 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:22.281727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:22.281736 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:22.281804 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:22.281805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:22.281815 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:22.281872 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:22.282159 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:22.282661 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:22.283405 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:22.283591 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:22.283636 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:22.286069 (+ 2433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:36865: BlockingRecv error: recv got EOF from 127.5.226.65:36865 (error 108)
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":53,"threads_started":1}
Aug 11 18:58:22 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:22 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:22.411425 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:22.406913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:43883)
0811 18:58:22.407043 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:22.407054 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:22.407113 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:22.407249 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:22.407249 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:22.407425 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:22.407489 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:22.407491 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:22.408092 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:22.408093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:22.408663 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:22.408665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:22.409044 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:22.409045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:22.409101 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:22.409564 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:22.409569 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:22.411346 (+ 1777us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":72,"threads_started":1}
W20260811 18:58:22.411500 24183 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:22.407004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:43883 (local address 127.5.226.126:33055)
0811 18:58:22.407060 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:22.407062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:22.407105 (+ 43us) server_negotiation.cc:407] Connection header received
0811 18:58:22.407176 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:22.407177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:22.407188 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:22.407229 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:22.407539 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:22.408027 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:22.408750 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:22.408961 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:22.409012 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:22.411447 (+ 2435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:43883: BlockingRecv error: recv got EOF from 127.5.226.66:43883 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 11 18:58:22 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:22 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:22.541913 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:22.537087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:47731)
0811 18:58:22.537240 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:22.537253 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:22.537336 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:22.537490 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:22.537490 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:22.537664 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:22.537723 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:22.537725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:22.538470 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:22.538472 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:22.539057 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:22.539060 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:22.539442 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:22.539443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:22.539491 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:22.539994 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:22.540000 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:22.541842 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":57,"threads_started":1}
W20260811 18:58:22.541980 24183 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:22.537174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:47731 (local address 127.5.226.126:33055)
0811 18:58:22.537261 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:22.537263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:22.537351 (+ 88us) server_negotiation.cc:407] Connection header received
0811 18:58:22.537401 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:22.537402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:22.537416 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:22.537475 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:22.537815 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:22.538376 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:22.539161 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:22.539370 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:22.539422 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:22.541928 (+ 2506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:47731: BlockingRecv error: recv got EOF from 127.5.226.67:47731 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 18:58:23 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:23 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:23.291594 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:23.286546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:54659)
0811 18:58:23.286675 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:23.286686 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:23.286742 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:23.286934 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:23.286936 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:23.287099 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:23.287151 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:23.287153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:23.288049 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:23.288051 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:23.288686 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:23.288689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:23.289084 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:23.289085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:23.289141 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:23.289665 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:23.289670 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:23.291513 (+ 1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":63,"threads_started":1}
W20260811 18:58:23.291694 24189 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:23.286628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:54659 (local address 127.5.226.126:33055)
0811 18:58:23.286741 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:23.286743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:23.286753 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:58:23.286789 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:23.286789 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:23.286800 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:23.286864 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:23.287245 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:23.287946 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:23.288774 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:23.288983 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:23.289040 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:23.291631 (+ 2591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:54659: BlockingRecv error: recv got EOF from 127.5.226.65:54659 (error 108)
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":57,"threads_started":1}
Aug 11 18:58:23 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:23 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:23.416816 24195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:23.411931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:40587)
0811 18:58:23.412102 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:23.412114 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:23.412187 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:23.412347 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:23.412349 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:23.412523 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:23.412587 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:23.412589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:23.413558 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:23.413559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:23.414129 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:23.414132 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:23.414488 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:23.414489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:23.414547 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:23.414948 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:23.414952 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:23.416755 (+ 1803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":74,"threads_started":1}
W20260811 18:58:23.416922 24189 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:23.412030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:40587 (local address 127.5.226.126:33055)
0811 18:58:23.412096 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:23.412098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:23.412176 (+ 78us) server_negotiation.cc:407] Connection header received
0811 18:58:23.412245 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:23.412246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:23.412256 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:23.412325 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:23.412680 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:23.413483 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:23.414223 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:23.414423 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:23.414480 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:23.416861 (+ 2381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:40587: BlockingRecv error: recv got EOF from 127.5.226.66:40587 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 18:58:23 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:23 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:23.547395 24198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:23.542444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:38685)
0811 18:58:23.542617 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:23.542629 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:23.542706 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:23.542860 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:23.542861 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:23.543054 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:23.543108 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:23.543109 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:23.543820 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:23.543821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:23.544359 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:23.544362 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:23.544749 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:23.544750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:23.544814 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:23.545405 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:23.545411 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:23.547307 (+ 1896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":108,"threads_started":1}
W20260811 18:58:23.547458 24189 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:23.542613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:38685 (local address 127.5.226.126:33055)
0811 18:58:23.542668 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:23.542670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:23.542683 (+ 13us) server_negotiation.cc:407] Connection header received
0811 18:58:23.542777 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:23.542778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:23.542794 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:23.542847 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:23.543231 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:23.543734 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:23.544443 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:23.544680 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:23.544745 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:23.547393 (+ 2648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:38685: BlockingRecv error: recv got EOF from 127.5.226.67:38685 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 18:58:24 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:24 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:24.299952 24199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:24.292153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:43737)
0811 18:58:24.292287 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:24.292299 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:24.292355 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:24.292548 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:24.292549 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:24.292741 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:24.292803 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:24.292805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:24.293638 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:24.293639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:24.294174 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:24.294176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:24.294520 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:24.294521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:24.294559 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:24.298044 (+ 3485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:24.298049 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:24.299893 (+ 1844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":71,"threads_started":1}
W20260811 18:58:24.300099 24200 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:24.292243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:43737 (local address 127.5.226.126:33055)
0811 18:58:24.292393 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:24.292394 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:24.292405 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:58:24.292433 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:24.292433 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:24.292445 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:24.292531 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:24.292879 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:24.293574 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:24.294265 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:24.294464 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:24.294519 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:24.300019 (+ 5500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:43737: BlockingRecv error: recv got EOF from 127.5.226.65:43737 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":84,"threads_started":1}
Aug 11 18:58:24 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:24 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:24.421623 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:24.417322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:54853)
0811 18:58:24.417447 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:24.417458 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:24.417515 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:24.417638 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:24.417639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:24.417809 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:24.417857 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:24.417859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:24.418495 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:24.418495 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:24.419019 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:24.419021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:24.419333 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:24.419334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:24.419371 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:24.419834 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:24.419840 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:24.421542 (+ 1702us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":68,"threads_started":1}
W20260811 18:58:24.421734 24200 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:24.417368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:54853 (local address 127.5.226.126:33055)
0811 18:58:24.417414 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:24.417417 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:24.417503 (+ 86us) server_negotiation.cc:407] Connection header received
0811 18:58:24.417578 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:24.417579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:24.417593 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:24.417632 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:24.417921 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:24.418434 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:24.419086 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:24.419281 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:24.419330 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:24.421650 (+ 2320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:54853: BlockingRecv error: recv got EOF from 127.5.226.66:54853 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 11 18:58:24 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:24 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:24.552402 24205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:24.547851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:47873)
0811 18:58:24.547990 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:24.548000 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:24.548067 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:24.548209 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:24.548209 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:24.548383 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:24.548436 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:24.548437 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:24.549102 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:24.549102 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:24.549681 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:24.549684 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:24.549994 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:24.549995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:24.550032 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:24.550460 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:24.550465 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:24.552340 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
W20260811 18:58:24.552502 24200 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:24.547950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:47873 (local address 127.5.226.126:33055)
0811 18:58:24.548008 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:24.548010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:24.548054 (+ 44us) server_negotiation.cc:407] Connection header received
0811 18:58:24.548134 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:24.548134 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:24.548146 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:24.548189 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:24.548534 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:24.549041 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:24.549755 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:24.549938 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:24.549989 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:24.552438 (+ 2449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:47873: BlockingRecv error: recv got EOF from 127.5.226.67:47873 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 18:58:25 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:25 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:25.305037 24206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:25.300387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:52021)
0811 18:58:25.300553 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:25.300564 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:25.300632 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:25.300782 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:25.300783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:25.300968 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:25.301027 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:25.301029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:25.301735 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:25.301737 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:25.302292 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:25.302294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:25.302593 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:25.302593 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:25.302633 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:25.303102 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:25.303107 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:25.304958 (+ 1851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":95,"threads_started":1}
W20260811 18:58:25.305119 24208 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:25.300441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:52021 (local address 127.5.226.126:33055)
0811 18:58:25.300559 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:25.300560 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:25.300618 (+ 58us) server_negotiation.cc:407] Connection header received
0811 18:58:25.300695 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:25.300695 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:25.300706 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:25.300765 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:25.301086 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:25.301634 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:25.302363 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:25.302544 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:25.302585 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:25.305060 (+ 2475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:52021: BlockingRecv error: recv got EOF from 127.5.226.65:52021 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":58,"threads_started":1}
Aug 11 18:58:25 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:25 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:25.426740 24209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:25.422177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:44085)
0811 18:58:25.422362 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:25.422372 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:25.422451 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:25.422591 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:25.422592 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:25.422789 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:25.422840 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:25.422842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:25.423497 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:25.423498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:25.424053 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:25.424056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:25.424402 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:25.424403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:25.424461 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:25.424902 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:25.424921 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:25.426638 (+ 1717us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":76,"threads_started":1}
W20260811 18:58:25.426800 24208 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:25.422259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:44085 (local address 127.5.226.126:33055)
0811 18:58:25.422328 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:25.422330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:25.422450 (+ 120us) server_negotiation.cc:407] Connection header received
0811 18:58:25.422520 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:25.422521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:25.422533 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:25.422575 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:25.422922 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:25.423422 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:25.424144 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:25.424338 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:25.424393 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:25.426744 (+ 2351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:44085: BlockingRecv error: recv got EOF from 127.5.226.66:44085 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 18:58:25 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:25 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:25.557381 24214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:25.552882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:50859)
0811 18:58:25.553031 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:25.553043 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:25.553104 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:25.553226 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:25.553227 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:25.553416 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:25.553470 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:25.553472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:25.554090 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:25.554091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:25.554652 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:25.554654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:25.554941 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:25.554942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:25.554979 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:25.555400 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:25.555404 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:25.557261 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":69,"threads_started":1}
W20260811 18:58:25.557469 24208 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:25.552943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:50859 (local address 127.5.226.126:33055)
0811 18:58:25.552997 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:25.552999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:25.553101 (+ 102us) server_negotiation.cc:407] Connection header received
0811 18:58:25.553159 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:25.553159 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:25.553172 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:25.553210 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:25.553521 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:25.554022 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:25.554719 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:25.554894 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:25.554936 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:25.557410 (+ 2474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:50859: BlockingRecv error: recv got EOF from 127.5.226.67:50859 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 11 18:58:26 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:26 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:26.309926 24216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:26.305531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:57179)
0811 18:58:26.305680 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:26.305703 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:26.305765 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:26.305881 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:26.305882 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:26.306047 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:26.306099 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:26.306101 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:26.306734 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:26.306735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:26.307272 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:26.307273 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:26.307560 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:26.307560 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:26.307599 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:26.308014 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:26.308019 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:26.309847 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":91,"threads_started":1}
W20260811 18:58:26.310019 24218 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:26.305593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:57179 (local address 127.5.226.126:33055)
0811 18:58:26.305699 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:26.305701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:26.305746 (+ 45us) server_negotiation.cc:407] Connection header received
0811 18:58:26.305817 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:26.305817 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:26.305829 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:26.305874 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:26.306156 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:26.306670 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:26.307329 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:26.307509 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:26.307553 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:26.309956 (+ 2403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:57179: BlockingRecv error: recv got EOF from 127.5.226.65:57179 (error 108)
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":49,"threads_started":1}
Aug 11 18:58:26 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:26 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:26.431584 24224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:26.427263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:50643)
0811 18:58:26.427449 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:26.427461 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:26.427526 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:26.427643 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:26.427644 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:26.427812 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:26.427862 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:26.427864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:26.428466 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:26.428467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:26.429045 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:26.429049 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:26.429357 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:26.429358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:26.429403 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:26.429804 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:26.429809 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:26.431526 (+ 1717us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":101,"threads_started":1}
W20260811 18:58:26.431677 24218 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:26.427417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:50643 (local address 127.5.226.126:33055)
0811 18:58:26.427466 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:26.427468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:26.427511 (+ 43us) server_negotiation.cc:407] Connection header received
0811 18:58:26.427581 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:26.427581 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:26.427591 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:26.427628 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:26.427912 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:26.428409 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:26.429107 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:26.429311 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:26.429354 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:26.431614 (+ 2260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:50643: BlockingRecv error: recv got EOF from 127.5.226.66:50643 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 11 18:58:26 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:26 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:26.562505 24226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:26.557893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:52323)
0811 18:58:26.558032 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:26.558044 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:26.558110 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:26.558239 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:26.558240 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:26.558412 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:26.558475 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:26.558477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:26.559125 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:26.559127 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:26.559662 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:26.559664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:26.559994 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:26.559995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:26.560053 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:26.560488 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:26.560493 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:26.562404 (+ 1911us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
W20260811 18:58:26.562538 24218 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:26.557976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:52323 (local address 127.5.226.126:33055)
0811 18:58:26.558037 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:26.558039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:26.558103 (+ 64us) server_negotiation.cc:407] Connection header received
0811 18:58:26.558164 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:26.558165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:26.558179 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:26.558227 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:26.558552 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:26.559051 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:26.559741 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:26.559933 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:26.559987 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:26.562488 (+ 2501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:52323: BlockingRecv error: recv got EOF from 127.5.226.67:52323 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 11 18:58:27 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:27 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:27.314939 24227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:27.310422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:52037)
0811 18:58:27.310553 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:27.310566 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:27.310631 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:27.310770 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:27.310771 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:27.310944 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:27.310995 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:27.310997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:27.311600 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:27.311600 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:27.312209 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:27.312213 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:27.312630 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:27.312631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:27.312680 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:27.313146 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:27.313152 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:27.314878 (+ 1726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":63,"threads_started":1}
W20260811 18:58:27.315119 24228 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:27.310486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:52037 (local address 127.5.226.126:33055)
0811 18:58:27.310638 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:27.310639 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:27.310650 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:58:27.310674 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:27.310675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:27.310686 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:27.310756 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:27.311049 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:27.311543 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:27.312285 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:27.312564 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:27.312620 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:27.315032 (+ 2412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:52037: BlockingRecv error: recv got EOF from 127.5.226.65:52037 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
Aug 11 18:58:27 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:27 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:27.436565 24230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:27.432039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:43441)
0811 18:58:27.432176 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:27.432188 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:27.432246 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:27.432384 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:27.432385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:27.432543 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:27.432594 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:27.432595 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:27.433253 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:27.433254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:27.433834 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:27.433836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:27.434159 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:27.434160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:27.434195 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:27.434694 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:27.434700 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:27.436506 (+ 1806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":60,"threads_started":1}
W20260811 18:58:27.436658 24228 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:27.432140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:43441 (local address 127.5.226.126:33055)
0811 18:58:27.432195 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:27.432197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:27.432235 (+ 38us) server_negotiation.cc:407] Connection header received
0811 18:58:27.432304 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:27.432304 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:27.432316 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:27.432375 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:27.432651 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:27.433191 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:27.433905 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:27.434100 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:27.434183 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:27.436598 (+ 2415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:43441: BlockingRecv error: recv got EOF from 127.5.226.66:43441 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 11 18:58:27 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:27 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:27.567739 24233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:27.563259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:45099)
0811 18:58:27.563422 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:27.563435 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:27.563490 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:27.563622 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:27.563623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:27.563797 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:27.563846 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:27.563848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:27.564487 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:27.564488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:27.565031 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:27.565033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:27.565389 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:27.565390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:27.565441 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:27.565883 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:27.565887 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:27.567677 (+ 1790us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":65,"threads_started":1}
W20260811 18:58:27.567871 24228 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:27.563386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:45099 (local address 127.5.226.126:33055)
0811 18:58:27.563476 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:27.563477 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:27.563490 (+ 13us) server_negotiation.cc:407] Connection header received
0811 18:58:27.563535 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:27.563536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:27.563551 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:27.563609 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:27.563903 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:27.564418 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:27.565098 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:27.565322 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:27.565375 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:27.567802 (+ 2427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:45099: BlockingRecv error: recv got EOF from 127.5.226.67:45099 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 18:58:28 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:28 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:28.320588 24236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:28.315453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:50597)
0811 18:58:28.315585 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:28.315598 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:28.315651 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:28.315835 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:28.315836 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:28.316019 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:28.316071 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:28.316073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:28.316941 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:28.316943 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:28.317858 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:28.317862 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:28.318214 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:28.318215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:28.318272 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:28.318740 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:28.318745 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:28.320530 (+ 1785us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":74,"threads_started":1}
W20260811 18:58:28.320695 24237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:28.315544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:50597 (local address 127.5.226.126:33055)
0811 18:58:28.315702 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:28.315705 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:28.315714 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:28.315741 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:28.315742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:28.315753 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:28.315818 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:28.316161 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:28.316853 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:28.317941 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:28.318146 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:28.318212 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:28.320619 (+ 2407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:50597: BlockingRecv error: recv got EOF from 127.5.226.65:50597 (error 108)
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
Aug 11 18:58:28 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:28 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:28.441737 24238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:28.437026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:54803)
0811 18:58:28.437189 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:28.437223 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:28.437332 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:28.437472 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:28.437473 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:28.437642 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:28.437694 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:28.437696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:28.438354 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:28.438355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:28.438968 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:28.438971 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:28.439334 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:28.439335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:28.439382 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:28.439796 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:28.439800 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:28.441639 (+ 1839us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":69,"threads_started":1}
W20260811 18:58:28.441808 24237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:28.437104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:54803 (local address 127.5.226.126:33055)
0811 18:58:28.437181 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:28.437184 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:28.437307 (+ 123us) server_negotiation.cc:407] Connection header received
0811 18:58:28.437398 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:28.437399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:28.437410 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:28.437457 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:28.437746 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:28.438280 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:28.439048 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:28.439245 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:28.439300 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:28.441744 (+ 2444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:54803: BlockingRecv error: recv got EOF from 127.5.226.66:54803 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 18:58:28 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:28 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:28.572871 24239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:28.568270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:35791)
0811 18:58:28.568406 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:28.568418 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:28.568484 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:28.568623 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:28.568624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:28.568810 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:28.568863 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:28.568865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:28.569565 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:28.569566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:28.570092 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:28.570094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:28.570430 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:28.570431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:28.570489 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:28.570935 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:28.570940 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:28.572790 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
W20260811 18:58:28.572937 24237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:28.568403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:35791 (local address 127.5.226.126:33055)
0811 18:58:28.568465 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:28.568466 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:28.568475 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:28.568547 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:28.568547 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:28.568564 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:28.568612 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:28.568943 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:28.569485 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:28.570172 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:28.570366 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:28.570422 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:28.572880 (+ 2458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:35791: BlockingRecv error: recv got EOF from 127.5.226.67:35791 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 18:58:29 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:29 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:29.329692 24242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:29.321019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:48713)
0811 18:58:29.321143 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:29.321153 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:29.321201 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:29.321469 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:29.321470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:29.321639 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:29.321691 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:29.321693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:29.322351 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:29.322352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:29.322887 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:29.322889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:29.323247 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:29.323247 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:29.323304 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:29.327738 (+ 4434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:29.327743 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:29.329622 (+ 1879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":60,"threads_started":1}
W20260811 18:58:29.329794 24247 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:29.321196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:48713 (local address 127.5.226.126:33055)
0811 18:58:29.321346 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:29.321348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:29.321355 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:58:29.321380 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:29.321381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:29.321392 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:29.321460 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:29.321754 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:29.322275 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:29.322963 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:29.323182 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:29.323241 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:29.329723 (+ 6482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:48713: BlockingRecv error: recv got EOF from 127.5.226.65:48713 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":74,"threads_started":1}
Aug 11 18:58:29 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:29 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:29.447489 24249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:29.442255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:39065)
0811 18:58:29.442470 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:29.442484 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:29.442571 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:29.442725 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:29.442726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:29.442907 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:29.442956 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:29.442958 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:29.443772 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:29.443773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:29.444343 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:29.444346 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:29.444728 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:29.444729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:29.444797 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:29.445351 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:29.445356 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:29.447405 (+ 2049us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":92,"threads_started":1}
W20260811 18:58:29.447574 24247 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:29.442376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:39065 (local address 127.5.226.126:33055)
0811 18:58:29.442483 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:29.442485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:29.442556 (+ 71us) server_negotiation.cc:407] Connection header received
0811 18:58:29.442649 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:29.442650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:29.442661 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:29.442712 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:29.443027 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:29.443694 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:29.444424 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:29.444645 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:29.444719 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:29.447507 (+ 2788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:39065: BlockingRecv error: recv got EOF from 127.5.226.66:39065 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 18:58:29 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:29 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:29.577905 24251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:29.573423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:37239)
0811 18:58:29.573566 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:29.573578 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:29.573646 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:29.573782 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:29.573783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:29.573963 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:29.574015 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:29.574017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:29.574654 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:29.574656 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:29.575177 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:29.575179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:29.575517 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:29.575517 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:29.575574 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:29.576008 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:29.576012 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:29.577825 (+ 1813us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":84,"threads_started":1}
W20260811 18:58:29.577979 24247 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:29.573491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:37239 (local address 127.5.226.126:33055)
0811 18:58:29.573560 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:29.573563 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:29.573636 (+ 73us) server_negotiation.cc:407] Connection header received
0811 18:58:29.573707 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:29.573708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:29.573722 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:29.573769 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:29.574089 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:29.574583 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:29.575254 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:29.575454 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:29.575509 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:29.577914 (+ 2405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:37239: BlockingRecv error: recv got EOF from 127.5.226.67:37239 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 18:58:30 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:30 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:30.334823 24253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:30.330184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:50137)
0811 18:58:30.330391 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:30.330405 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:30.330463 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:30.330606 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:30.330607 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:30.330779 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:30.330834 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:30.330836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:30.331535 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:30.331535 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:30.332063 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:30.332065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:30.332432 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:30.332432 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:30.332468 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:30.332913 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:30.332917 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:30.334762 (+ 1845us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":87,"threads_started":1}
W20260811 18:58:30.334960 24256 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:30.330309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:50137 (local address 127.5.226.126:33055)
0811 18:58:30.330445 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:30.330447 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:30.330456 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:30.330510 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:30.330511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:30.330523 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:30.330594 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:30.330913 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:30.331465 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:30.332138 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:30.332370 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:30.332431 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:30.334882 (+ 2451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:50137: BlockingRecv error: recv got EOF from 127.5.226.65:50137 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
Aug 11 18:58:30 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:30 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:30.452368 24258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:30.447932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:49941)
0811 18:58:30.448079 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:30.448091 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:30.448149 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:30.448269 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:30.448270 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:30.448442 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:30.448493 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:30.448495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:30.449120 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:30.449122 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:30.449717 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:30.449720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:30.450041 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:30.450042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:30.450081 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:30.450513 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:30.450518 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:30.452308 (+ 1790us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":66,"threads_started":1}
W20260811 18:58:30.452477 24256 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:30.447991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:49941 (local address 127.5.226.126:33055)
0811 18:58:30.448039 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:30.448040 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:30.448143 (+ 103us) server_negotiation.cc:407] Connection header received
0811 18:58:30.448191 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:30.448192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:30.448204 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:30.448255 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:30.448543 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:30.449042 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:30.449789 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:30.449984 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:30.450035 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:30.452408 (+ 2373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:49941: BlockingRecv error: recv got EOF from 127.5.226.66:49941 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 11 18:58:30 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:30 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:30.583132 24259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:30.578344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:60005)
0811 18:58:30.578477 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:30.578487 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:30.578550 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:30.578662 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:30.578662 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:30.578839 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:30.578890 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:30.578892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:30.579533 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:30.579534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:30.580107 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:30.580109 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:30.580472 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:30.580474 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:30.580523 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:30.580996 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:30.581001 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:30.583070 (+ 2069us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":60,"threads_started":1}
W20260811 18:58:30.583240 24256 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:30.578424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:60005 (local address 127.5.226.126:33055)
0811 18:58:30.578477 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:30.578479 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:30.578542 (+ 63us) server_negotiation.cc:407] Connection header received
0811 18:58:30.578591 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:30.578592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:30.578604 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:30.578647 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:30.578938 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:30.579441 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:30.580221 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:30.580407 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:30.580451 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:30.583175 (+ 2724us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:60005: BlockingRecv error: recv got EOF from 127.5.226.67:60005 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 11 18:58:31 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:31 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:31.340547 24260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:31.335395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:55389)
0811 18:58:31.335544 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:31.335555 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:31.335620 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:31.335774 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:31.335775 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:31.335966 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:31.336053 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:31.336055 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:31.337011 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:31.337012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:31.337639 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:31.337642 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:31.338018 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:31.338019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:31.338066 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:31.338577 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:31.338582 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:31.340487 (+ 1905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":84,"threads_started":1}
W20260811 18:58:31.340689 24261 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:31.335504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:55389 (local address 127.5.226.126:33055)
0811 18:58:31.335634 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:31.335636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:31.335646 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:58:31.335677 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:31.335678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:31.335690 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:31.335766 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:31.336145 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:31.336923 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:31.337731 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:31.337944 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:31.338007 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:31.340610 (+ 2603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:55389: BlockingRecv error: recv got EOF from 127.5.226.65:55389 (error 108)
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":57,"threads_started":1}
Aug 11 18:58:31 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:31 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:31.457803 24262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:31.452877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:33793)
0811 18:58:31.453047 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:31.453061 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:31.453142 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:31.453324 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:31.453326 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:31.453513 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:31.453567 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:31.453569 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:31.454238 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:31.454239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:31.454818 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:31.454820 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:31.455212 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:31.455213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:31.455265 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:31.455807 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:31.455812 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:31.457739 (+ 1927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":74,"threads_started":1}
W20260811 18:58:31.457895 24261 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:31.453000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:33793 (local address 127.5.226.126:33055)
0811 18:58:31.453099 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:31.453101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:31.453116 (+ 15us) server_negotiation.cc:407] Connection header received
0811 18:58:31.453215 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:31.453216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:31.453229 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:31.453305 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:31.453640 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:31.454160 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:31.454908 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:31.455107 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:31.455164 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:31.457835 (+ 2671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:33793: BlockingRecv error: recv got EOF from 127.5.226.66:33793 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 18:58:31 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:31 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:31.588372 24263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:31.583616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:36057)
0811 18:58:31.583759 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:31.583770 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:31.583828 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:31.583987 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:31.583988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:31.584161 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:31.584226 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:31.584227 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:31.584867 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:31.584868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:31.585528 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:31.585531 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:31.585977 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:31.585978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:31.586040 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:31.586520 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:31.586525 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:31.588312 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":63,"threads_started":1}
W20260811 18:58:31.588555 24261 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:31.583779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:36057 (local address 127.5.226.126:33055)
0811 18:58:31.583844 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:31.583846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:31.583855 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:31.583879 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:31.583880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:31.583892 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:31.583942 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:31.584288 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:31.584796 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:31.585609 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:31.585894 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:31.585954 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:31.588490 (+ 2536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:36057: BlockingRecv error: recv got EOF from 127.5.226.67:36057 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 18:58:32 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:32 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:32.345754 24264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:32.341039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:42855)
0811 18:58:32.341159 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:32.341170 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:32.341270 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:32.341464 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:32.341465 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:32.341670 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:32.341723 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:32.341726 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:32.342398 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:32.342399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:32.342972 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:32.342975 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:32.343288 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:32.343289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:32.343332 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:32.343766 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:32.343771 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:32.345682 (+ 1911us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":61,"threads_started":1}
W20260811 18:58:32.345918 24267 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:32.341101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:42855 (local address 127.5.226.126:33055)
0811 18:58:32.341244 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:32.341246 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:32.341255 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:32.341367 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:32.341368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:32.341380 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:32.341451 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:32.341785 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:32.342317 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:32.343048 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:32.343236 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:32.343278 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:32.345830 (+ 2552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:42855: BlockingRecv error: recv got EOF from 127.5.226.65:42855 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
Aug 11 18:58:32 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:32 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:32.463083 24268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:32.458338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:40255)
0811 18:58:32.458496 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:32.458508 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:32.458612 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:32.458758 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:32.458759 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:32.458949 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:32.458996 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:32.458998 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:32.459776 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:32.459777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:32.460410 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:32.460414 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:32.460743 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:32.460743 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:32.460780 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:32.461183 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:32.461187 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:32.463006 (+ 1819us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":74,"threads_started":1}
W20260811 18:58:32.463215 24267 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:32.458455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:40255 (local address 127.5.226.126:33055)
0811 18:58:32.458526 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:32.458528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:32.458566 (+ 38us) server_negotiation.cc:407] Connection header received
0811 18:58:32.458676 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:32.458676 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:32.458689 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:32.458742 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:32.459071 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:32.459695 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:32.460490 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:32.460686 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:32.460739 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:32.463111 (+ 2372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:40255: BlockingRecv error: recv got EOF from 127.5.226.66:40255 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 18:58:32 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:32 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:32.593765 24269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:32.588908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:41333)
0811 18:58:32.589066 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:32.589077 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:32.589141 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:32.589332 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:32.589333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:32.589530 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:32.589581 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:32.589583 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:32.590432 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:32.590434 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:32.591012 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:32.591014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:32.591345 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:32.591347 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:32.591399 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:32.591864 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:32.591869 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:32.593691 (+ 1822us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":66,"threads_started":1}
W20260811 18:58:32.593852 24267 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:32.588982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:41333 (local address 127.5.226.126:33055)
0811 18:58:32.589038 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:32.589040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:32.589124 (+ 84us) server_negotiation.cc:407] Connection header received
0811 18:58:32.589205 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:32.589206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:32.589238 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:32.589278 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:32.589650 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:32.590346 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:32.591085 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:32.591269 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:32.591321 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:32.593790 (+ 2469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:41333: BlockingRecv error: recv got EOF from 127.5.226.67:41333 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 11 18:58:33 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:33 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:33.351159 24270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:33.346282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:39519)
0811 18:58:33.346423 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:33.346436 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:33.346510 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:33.346676 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:33.346677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:33.346860 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:33.346909 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:33.346911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:33.347579 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:33.347580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:33.348312 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:33.348316 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:33.348788 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:33.348789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:33.348848 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:33.349333 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:33.349338 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:33.351100 (+ 1762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
W20260811 18:58:33.351298 24271 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:33.346330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:39519 (local address 127.5.226.126:33055)
0811 18:58:33.346462 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:33.346464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:33.346474 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:58:33.346567 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:33.346568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:33.346581 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:33.346648 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:33.346973 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:33.347480 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:33.348390 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:33.348714 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:33.348784 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:33.351208 (+ 2424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:39519: BlockingRecv error: recv got EOF from 127.5.226.65:39519 (error 108)
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":64,"threads_started":1}
Aug 11 18:58:33 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:33 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:33.468216 24277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:33.463631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:48939)
0811 18:58:33.463759 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:33.463771 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:33.463848 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:33.463987 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:33.463988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:33.464156 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:33.464205 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:33.464206 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:33.464923 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:33.464923 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:33.465519 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:33.465521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:33.465944 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:33.465946 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:33.465994 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:33.466458 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:33.466462 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:33.468158 (+ 1696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
W20260811 18:58:33.468346 24271 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:33.463735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:48939 (local address 127.5.226.126:33055)
0811 18:58:33.463788 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:33.463789 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:33.463828 (+ 39us) server_negotiation.cc:407] Connection header received
0811 18:58:33.463911 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:33.463912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:33.463924 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:33.463970 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:33.464298 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:33.464849 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:33.465580 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:33.465868 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:33.465929 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:33.468275 (+ 2346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:48939: BlockingRecv error: recv got EOF from 127.5.226.66:48939 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 11 18:58:33 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:33 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:33.598901 24278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:33.594256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:36767)
0811 18:58:33.594430 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:33.594442 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:33.594513 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:33.594634 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:33.594634 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:33.594837 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:33.594892 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:33.594894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:33.595517 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:33.595518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:33.596267 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:33.596271 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:33.596618 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:33.596618 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:33.596668 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:33.597102 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:33.597106 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:33.598843 (+ 1737us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":89,"threads_started":1}
W20260811 18:58:33.598991 24271 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:33.594385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:36767 (local address 127.5.226.126:33055)
0811 18:58:33.594445 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:33.594447 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:33.594503 (+ 56us) server_negotiation.cc:407] Connection header received
0811 18:58:33.594560 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:33.594561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:33.594573 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:33.594621 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:33.594944 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:33.595445 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:33.596346 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:33.596559 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:33.596613 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:33.598930 (+ 2317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:36767: BlockingRecv error: recv got EOF from 127.5.226.67:36767 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 18:58:34 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:34 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:34.398599 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:34.351692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:45087)
0811 18:58:34.351865 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:34.351880 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:34.351974 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:34.352126 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:34.352127 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:34.352345 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:34.352400 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:34.352403 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:34.353061 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:34.353062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:34.353755 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:34.353759 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:34.354137 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:34.354139 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:34.354192 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:34.396419 (+ 42227us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:34.396426 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:34.398523 (+ 2097us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":77,"threads_started":1}
W20260811 18:58:34.398759 24282 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:34.351766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:45087 (local address 127.5.226.126:33055)
0811 18:58:34.351873 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:34.351875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:34.351961 (+ 86us) server_negotiation.cc:407] Connection header received
0811 18:58:34.352036 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:34.352036 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:34.352048 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:34.352108 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:34.352460 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:34.352971 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:34.353848 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:34.354046 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:34.354101 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:34.398673 (+ 44572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:45087: BlockingRecv error: recv got EOF from 127.5.226.65:45087 (error 108)
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":51,"threads_started":1}
Aug 11 18:58:34 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:34 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:34.473537 24286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:34.468670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:41985)
0811 18:58:34.468853 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:34.468867 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:34.468944 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:34.469071 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:34.469072 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:34.469271 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:34.469343 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:34.469346 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:34.470000 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:34.470001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:34.470532 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:34.470533 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:34.470873 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:34.470874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:34.470949 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:34.471403 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:34.471408 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:34.473475 (+ 2067us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":79,"threads_started":1}
W20260811 18:58:34.473630 24282 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:34.468833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:41985 (local address 127.5.226.126:33055)
0811 18:58:34.468892 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:34.468894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:34.468922 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:58:34.469003 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:34.469004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:34.469016 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:34.469064 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:34.469422 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:34.469922 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:34.470607 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:34.470808 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:34.470864 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:34.473571 (+ 2707us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:41985: BlockingRecv error: recv got EOF from 127.5.226.66:41985 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 11 18:58:34 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:34 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:34.604158 24287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:34.599460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:43409)
0811 18:58:34.599615 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:34.599628 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:34.599700 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:34.599842 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:34.599843 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:34.600016 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:34.600065 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:34.600067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:34.600695 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:34.600696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:34.601220 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:34.601222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:34.601601 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:34.601602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:34.601657 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:34.602108 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:34.602113 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:34.604074 (+ 1961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":69,"threads_started":1}
W20260811 18:58:34.604311 24282 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:34.599544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:43409 (local address 127.5.226.126:33055)
0811 18:58:34.599612 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:34.599614 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:34.599691 (+ 77us) server_negotiation.cc:407] Connection header received
0811 18:58:34.599746 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:34.599747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:34.599762 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:34.599821 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:34.600126 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:34.600625 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:34.601316 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:34.601508 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:34.601564 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:34.604237 (+ 2673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:43409: BlockingRecv error: recv got EOF from 127.5.226.67:43409 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 18:58:35 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:35 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:35.403759 24288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:35.399082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:49063)
0811 18:58:35.399217 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:35.399227 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:35.399286 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:35.399503 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:35.399504 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:35.399682 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:35.399734 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:35.399735 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:35.400439 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:35.400440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:35.400977 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:35.400979 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:35.401518 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:35.401519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:35.401582 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:35.402000 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:35.402004 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:35.403700 (+ 1696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
W20260811 18:58:35.403889 24289 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:35.399198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:49063 (local address 127.5.226.126:33055)
0811 18:58:35.399330 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:35.399332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:35.399340 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:58:35.399363 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:35.399364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:35.399374 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:35.399434 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:35.399803 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:35.400364 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:35.401115 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:35.401427 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:35.401494 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:35.403810 (+ 2316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:49063: BlockingRecv error: recv got EOF from 127.5.226.65:49063 (error 108)
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":53,"threads_started":1}
Aug 11 18:58:35 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:35 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:35.478698 24290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:35.474029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:35839)
0811 18:58:35.474168 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:35.474179 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:35.474247 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:35.474388 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:35.474389 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:35.474572 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:35.474622 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:35.474624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:35.475285 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:35.475286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:35.475813 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:35.475815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:35.476159 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:35.476160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:35.476218 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:35.476724 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:35.476730 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:35.478638 (+ 1908us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":68,"threads_started":1}
W20260811 18:58:35.478822 24289 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:35.474161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:35839 (local address 127.5.226.126:33055)
0811 18:58:35.474263 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:35.474265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:35.474275 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:58:35.474310 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:35.474311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:35.474324 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:35.474371 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:35.474700 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:35.475195 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:35.475895 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:35.476095 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:35.476151 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:35.478758 (+ 2607us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:35839: BlockingRecv error: recv got EOF from 127.5.226.66:35839 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 18:58:35 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:35 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.67@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:35.609526 24291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:35.604642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.67:58289)
0811 18:58:35.604857 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:35.604872 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:35.604950 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:35.605105 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:35.605106 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:35.605326 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:35.605386 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:35.605389 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:35.606081 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:35.606083 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:35.606619 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:35.606621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:35.606946 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:35.606946 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:35.606985 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:35.607431 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:35.607437 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:35.609466 (+ 2029us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":66,"threads_started":1}
W20260811 18:58:35.609671 24289 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:35.604738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:58289 (local address 127.5.226.126:33055)
0811 18:58:35.604820 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:35.604822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:35.604991 (+ 169us) server_negotiation.cc:407] Connection header received
0811 18:58:35.605024 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:35.605025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:35.605045 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:35.605089 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:35.605474 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:35.605996 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:35.606698 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:35.606890 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:35.606948 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:35.609581 (+ 2633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.67:58289: BlockingRecv error: recv got EOF from 127.5.226.67:58289 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 18:58:36 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:36 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.65@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:36.409200 24292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:36.404341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.65:60993)
0811 18:58:36.404475 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:36.404486 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:36.404547 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:36.404698 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:36.404699 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:36.404870 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:36.404923 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:36.404925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:36.405667 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:36.405668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:36.406441 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:36.406445 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:36.406847 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:36.406848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:36.406903 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:36.407335 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:36.407339 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:36.409126 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":75,"threads_started":1}
W20260811 18:58:36.409325 24293 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:36.404451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:60993 (local address 127.5.226.126:33055)
0811 18:58:36.404571 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:36.404573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:36.404582 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:58:36.404609 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:36.404609 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:36.404620 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:36.404685 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:36.405022 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:36.405595 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:36.406520 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:36.406783 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:36.406836 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:36.409228 (+ 2392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.65:60993: BlockingRecv error: recv got EOF from 127.5.226.65:60993 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":53,"threads_started":1}
Aug 11 18:58:36 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:58:36 dist-test-slave-gjw7 krb5kdc[22249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.226.66@KRBTEST.COM for oryx/127.5.226.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:58:36.483562 24296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:36.479216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33055 (local address 127.5.226.66:43071)
0811 18:58:36.479354 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:36.479364 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:36.479418 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:36.479563 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:36.479564 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:36.479721 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:36.479771 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:36.479773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:36.480388 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:36.480388 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:36.480900 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:36.480902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:36.481205 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:36.481206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:36.481240 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:36.481706 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:36.481711 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:36.483502 (+ 1791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.226.126:33055: Server oryx/127.5.226.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":67,"threads_started":1}
W20260811 18:58:36.483669 24293 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:36.479307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:43071 (local address 127.5.226.126:33055)
0811 18:58:36.479385 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:36.479387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:36.479400 (+ 13us) server_negotiation.cc:407] Connection header received
0811 18:58:36.479482 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:36.479483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:36.479494 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:36.479550 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:36.479830 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:36.480331 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:36.480965 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:36.481153 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:36.481205 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:36.483608 (+ 2403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.226.66:43071: BlockingRecv error: recv got EOF from 127.5.226.66:43071 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 18:58:36.525242 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 23358
I20260811 18:58:36.557667 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 23651
I20260811 18:58:36.574507 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 23914
I20260811 18:58:36.590396 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 23230
2026-08-11T18:58:36Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17836 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T18:58:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:36Z Disabled control of system clock
I20260811 18:58:36.626292 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:46561
--webserver_interface=127.5.226.126
--webserver_port=0
--builtin_ntp_servers=127.5.226.84:43067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:46561
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 18:58:36.708849 24306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:36.709069 24306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:36.709087 24306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:36.710336 24306 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:36.710379 24306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:36.710390 24306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:36.710402 24306 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:36.710412 24306 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:36.711793 24306 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:43067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:46561
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:46561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:36.712041 24306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:36.712343 24306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:36.717510 24320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:36.717523 24318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:36.717551 24306 server_base.cc:1034] running on GCE node
W20260811 18:58:36.717516 24315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:36.718042 24306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:36.718366 24306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:36.719534 24306 hybrid_clock.cc:648] HybridClock initialized: now 1786474716719517 us; error 28 us; skew 500 ppm
I20260811 18:58:36.720806 24306 webserver.cc:460] Webserver started at http://127.5.226.126:42873/ using document root <none> and password file <none>
I20260811 18:58:36.721040 24306 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:36.721091 24306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:36.721241 24306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:36.722347 24306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "9eebff31b4274354a59e8d9d1636a0aa"
format_stamp: "Formatted at 2026-08-11 18:58:36 on dist-test-slave-gjw7"
server_key: "992ec487a9384919afd828781bd7af95"
server_key_iv: "ca6198da22b1fb33689d91aca869a4f0"
server_key_version: "encryptionkey@0"
I20260811 18:58:36.722703 24306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "9eebff31b4274354a59e8d9d1636a0aa"
format_stamp: "Formatted at 2026-08-11 18:58:36 on dist-test-slave-gjw7"
server_key: "992ec487a9384919afd828781bd7af95"
server_key_iv: "ca6198da22b1fb33689d91aca869a4f0"
server_key_version: "encryptionkey@0"
I20260811 18:58:36.723939 24306 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:58:36.724635 24335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:36.724781 24306 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:36.724870 24306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "9eebff31b4274354a59e8d9d1636a0aa"
format_stamp: "Formatted at 2026-08-11 18:58:36 on dist-test-slave-gjw7"
server_key: "992ec487a9384919afd828781bd7af95"
server_key_iv: "ca6198da22b1fb33689d91aca869a4f0"
server_key_version: "encryptionkey@0"
I20260811 18:58:36.724941 24306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:36.736635 24306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:36.736963 24306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:36.737094 24306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:36.741046 24306 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:46561
I20260811 18:58:36.741089 24430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:46561 every 8 connection(s)
I20260811 18:58:36.741490 24306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:36.742156 24431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:36.744747 24431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa: Bootstrap starting.
I20260811 18:58:36.745452 24431 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:36.745740 24431 log.cc:824] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:36.746407 24431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa: No bootstrap required, opened a new log
I20260811 18:58:36.748003 24431 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eebff31b4274354a59e8d9d1636a0aa" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46561 } }
I20260811 18:58:36.748144 24431 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:36.748165 24431 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eebff31b4274354a59e8d9d1636a0aa, State: Initialized, Role: FOLLOWER
I20260811 18:58:36.748293 24431 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eebff31b4274354a59e8d9d1636a0aa" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46561 } }
I20260811 18:58:36.748369 24431 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:36.748391 24431 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:36.748421 24431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:36.748946 24431 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eebff31b4274354a59e8d9d1636a0aa" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46561 } }
I20260811 18:58:36.749040 24431 leader_election.cc:302] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9eebff31b4274354a59e8d9d1636a0aa; no voters:
I20260811 18:58:36.749197 24431 leader_election.cc:288] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:36.749250 24435 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:36.749447 24431 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:36.749476 24435 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [term 1 LEADER]: Becoming Leader. State: Replica: 9eebff31b4274354a59e8d9d1636a0aa, State: Running, Role: LEADER
I20260811 18:58:36.749632 24435 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eebff31b4274354a59e8d9d1636a0aa" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46561 } }
I20260811 18:58:36.750043 24437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9eebff31b4274354a59e8d9d1636a0aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eebff31b4274354a59e8d9d1636a0aa" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46561 } } }
I20260811 18:58:36.750173 24441 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eebff31b4274354a59e8d9d1636a0aa. Latest consensus state: current_term: 1 leader_uuid: "9eebff31b4274354a59e8d9d1636a0aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eebff31b4274354a59e8d9d1636a0aa" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46561 } } }
I20260811 18:58:36.750193 24437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:36.750324 24441 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:36.750829 24456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:36.750880 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 24306
I20260811 18:58:36.750977 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:58:36.751178 6025 external_mini_cluster.cc:1428] Setting key b304eead8312633385f2025231fd85bf
I20260811 18:58:36.751415 24456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:36.753201 24456 catalog_manager.cc:1347] Generated new cluster ID: 75fe8190cdf54a2bbed042e4a62fecd6
I20260811 18:58:36.753270 24456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:36.756527 24473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:36.751791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39612 (local address 127.5.226.126:46561)
0811 18:58:36.751967 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:36.751975 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:36.752204 (+ 229us) server_negotiation.cc:407] Connection header received
0811 18:58:36.752357 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:36.752365 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:36.752448 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:36.752591 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:36.752816 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:36.753837 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:36.754586 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:36.755020 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:36.755130 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:36.755820 (+ 690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:36.755824 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:36.755825 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:36.756044 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:36.756078 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:36.756091 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:36.756149 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:36.756226 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 18:58:36.756305 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
I20260811 18:58:36.782426 24456 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:36.783156 24456 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:36.789108 24456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9eebff31b4274354a59e8d9d1636a0aa: Generated new TSK 0
I20260811 18:58:36.789343 24456 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:58:36.794401 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46561
--builtin_ntp_servers=127.5.226.84:43067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 18:58:36.893574 24475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:36.893814 24475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:36.893846 24475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:36.895061 24475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:36.895103 24475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:36.895136 24475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:58:36.896548 24475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:43067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:36.896812 24475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:36.897110 24475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:36.902016 24489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:36.902083 24484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:36.902051 24487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:36.902354 24475 server_base.cc:1034] running on GCE node
I20260811 18:58:36.902535 24475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:36.902745 24475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:36.903882 24475 hybrid_clock.cc:648] HybridClock initialized: now 1786474716903866 us; error 31 us; skew 500 ppm
I20260811 18:58:36.905067 24475 webserver.cc:460] Webserver started at http://127.5.226.65:39429/ using document root <none> and password file <none>
I20260811 18:58:36.905362 24475 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:36.905413 24475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:36.905546 24475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:36.906626 24475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "8a4bd476586a4750aabb76d2b3d3c19e"
format_stamp: "Formatted at 2026-08-11 18:58:36 on dist-test-slave-gjw7"
server_key: "8bc4bd7c2e7ef43b3795e7a5387315e2"
server_key_iv: "d4f306eabb18935bc96681bc9623cd7f"
server_key_version: "encryptionkey@0"
I20260811 18:58:36.906975 24475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "8a4bd476586a4750aabb76d2b3d3c19e"
format_stamp: "Formatted at 2026-08-11 18:58:36 on dist-test-slave-gjw7"
server_key: "8bc4bd7c2e7ef43b3795e7a5387315e2"
server_key_iv: "d4f306eabb18935bc96681bc9623cd7f"
server_key_version: "encryptionkey@0"
I20260811 18:58:36.908238 24475 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:58:36.908917 24498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:36.909070 24475 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:36.909157 24475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "8a4bd476586a4750aabb76d2b3d3c19e"
format_stamp: "Formatted at 2026-08-11 18:58:36 on dist-test-slave-gjw7"
server_key: "8bc4bd7c2e7ef43b3795e7a5387315e2"
server_key_iv: "d4f306eabb18935bc96681bc9623cd7f"
server_key_version: "encryptionkey@0"
I20260811 18:58:36.909236 24475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:36.916618 24475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:36.916895 24475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:36.917017 24475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:36.917237 24475 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:36.917598 24475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:36.917631 24475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:36.917660 24475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:36.917677 24475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:36.923378 24475 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:34951
I20260811 18:58:36.923446 24711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:34951 every 8 connection(s)
I20260811 18:58:36.923739 24475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 18:58:36.929039 24473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:36.924452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:50825 (local address 127.5.226.126:46561)
0811 18:58:36.924498 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:36.924500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:36.924743 (+ 243us) server_negotiation.cc:407] Connection header received
0811 18:58:36.925274 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:36.925276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:36.925330 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:36.925386 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:36.926083 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:36.926602 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:36.927641 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:36.927864 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:36.927921 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:36.928766 (+ 845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:36.928767 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:36.928768 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:36.928773 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:36.928798 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:36.928802 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:36.928845 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:36.928923 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 18:58:36.928955 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:58:36.929250 24717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:36.924431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:46561 (local address 127.5.226.65:50825)
0811 18:58:36.924631 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:36.924664 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:36.925172 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:36.925477 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:36.925481 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:36.925491 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:36.925988 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:36.925995 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:36.926697 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:36.926698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:36.927557 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:36.927560 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:36.927952 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:36.927953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:36.928086 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:36.928625 (+ 539us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:36.928626 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:36.928656 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:36.928680 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:36.928852 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:36.928859 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:36.928862 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:58:36.928922 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 18:58:36.929030 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
I20260811 18:58:36.929869 24713 heartbeater.cc:347] Connected to a master server at 127.5.226.126:46561
I20260811 18:58:36.929955 24713 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:36.930112 24713 heartbeater.cc:511] Master 127.5.226.126:46561 requested a full tablet report, sending...
I20260811 18:58:36.930624 24377 ts_manager.cc:194] Registered new tserver with Master: 8a4bd476586a4750aabb76d2b3d3c19e (127.5.226.65:34951)
I20260811 18:58:36.931090 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 24475
I20260811 18:58:36.931175 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:58:36.931368 6025 external_mini_cluster.cc:1428] Setting key a1ee97560454de111dbfcd8f12593fc8
I20260811 18:58:36.931473 24377 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.226.65:50825
I20260811 18:58:36.932269 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46561
--builtin_ntp_servers=127.5.226.84:43067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 18:58:37.015765 24720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:37.015991 24720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:37.016022 24720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:37.017194 24720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:37.017237 24720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:37.017269 24720 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:58:37.018640 24720 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:43067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:37.018883 24720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:37.019169 24720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:37.024053 24729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:37.024088 24731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:37.024088 24728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:37.024351 24720 server_base.cc:1034] running on GCE node
I20260811 18:58:37.024564 24720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:37.024796 24720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:37.025940 24720 hybrid_clock.cc:648] HybridClock initialized: now 1786474717025929 us; error 28 us; skew 500 ppm
I20260811 18:58:37.027148 24720 webserver.cc:460] Webserver started at http://127.5.226.66:40429/ using document root <none> and password file <none>
I20260811 18:58:37.027417 24720 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:37.027468 24720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:37.027597 24720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:37.028672 24720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "828bf6a918c14928be8680eaebbe5665"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "0e632914ba2f8bd04453a8de86bed47f"
server_key_iv: "c6e47017d82a6261253d1574f496f473"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.029009 24720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "828bf6a918c14928be8680eaebbe5665"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "0e632914ba2f8bd04453a8de86bed47f"
server_key_iv: "c6e47017d82a6261253d1574f496f473"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.030333 24720 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:58:37.031019 24745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.031189 24720 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:37.031277 24720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "828bf6a918c14928be8680eaebbe5665"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "0e632914ba2f8bd04453a8de86bed47f"
server_key_iv: "c6e47017d82a6261253d1574f496f473"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.031358 24720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:37.052635 24720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:37.052975 24720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:37.053112 24720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:37.053364 24720 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:37.053711 24720 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:37.053746 24720 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.053777 24720 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:37.053812 24720 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.059535 24720 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:37543
I20260811 18:58:37.059593 24991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:37543 every 8 connection(s)
I20260811 18:58:37.059916 24720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 18:58:37.064827 24473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:37.060637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:36833 (local address 127.5.226.126:46561)
0811 18:58:37.060690 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:37.060693 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:37.060927 (+ 234us) server_negotiation.cc:407] Connection header received
0811 18:58:37.061509 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:37.061510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:37.061520 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:37.061570 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:37.062205 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:37.062683 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:37.063627 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:37.063827 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:37.063876 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:37.064627 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:37.064628 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:37.064628 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:37.064632 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:37.064641 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:37.064645 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:37.064676 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:37.064742 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 18:58:37.064760 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:58:37.065037 24998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:37.060623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:46561 (local address 127.5.226.66:36833)
0811 18:58:37.060810 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:37.060845 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:37.061417 (+ 572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:37.061627 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:37.061631 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:37.061640 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:37.062145 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:37.062150 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:37.062751 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:37.062752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:37.063552 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:37.063554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:37.063887 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:37.063888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:37.063993 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:37.064510 (+ 517us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:37.064511 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:37.064542 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:37.064565 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:37.064686 (+ 121us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:37.064688 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:37.064690 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:58:37.064741 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 18:58:37.064825 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
I20260811 18:58:37.065505 24993 heartbeater.cc:347] Connected to a master server at 127.5.226.126:46561
I20260811 18:58:37.065596 24993 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:37.065778 24993 heartbeater.cc:511] Master 127.5.226.126:46561 requested a full tablet report, sending...
I20260811 18:58:37.066129 24377 ts_manager.cc:194] Registered new tserver with Master: 828bf6a918c14928be8680eaebbe5665 (127.5.226.66:37543)
I20260811 18:58:37.066505 24377 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.226.66:36833
I20260811 18:58:37.068011 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 24720
I20260811 18:58:37.068094 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:58:37.068274 6025 external_mini_cluster.cc:1428] Setting key 2449033e9005a1fa6e7982f4ac94fe55
I20260811 18:58:37.069084 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46561
--builtin_ntp_servers=127.5.226.84:43067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 18:58:37.153553 24999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:37.153785 24999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:37.153807 24999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:37.154979 24999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:37.155027 24999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:37.155054 24999 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:58:37.156531 24999 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:43067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:46561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24999
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:37.156816 24999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:37.157128 24999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:37.162130 25010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:37.162250 24999 server_base.cc:1034] running on GCE node
W20260811 18:58:37.162140 25011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:37.162323 25014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:37.162569 24999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:37.162793 24999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:37.163941 24999 hybrid_clock.cc:648] HybridClock initialized: now 1786474717163929 us; error 28 us; skew 500 ppm
I20260811 18:58:37.165148 24999 webserver.cc:460] Webserver started at http://127.5.226.67:34099/ using document root <none> and password file <none>
I20260811 18:58:37.165416 24999 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:37.165463 24999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:37.165599 24999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:37.166666 24999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "d8825de25e2d4a72881a00bbd4b203f6"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "3dd157d660ebe01235fd1edeb493f3c3"
server_key_iv: "78e7f5ddb5a98df1d22fb2e14e0a25e6"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.166997 24999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "d8825de25e2d4a72881a00bbd4b203f6"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "3dd157d660ebe01235fd1edeb493f3c3"
server_key_iv: "78e7f5ddb5a98df1d22fb2e14e0a25e6"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.168256 24999 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:58:37.168960 25025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.169102 24999 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:37.169193 24999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "d8825de25e2d4a72881a00bbd4b203f6"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "3dd157d660ebe01235fd1edeb493f3c3"
server_key_iv: "78e7f5ddb5a98df1d22fb2e14e0a25e6"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.169262 24999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:37.196777 24999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:37.197114 24999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:37.197247 24999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:37.197542 24999 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:37.197889 24999 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:37.197933 24999 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.197965 24999 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:37.197983 24999 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.203459 24999 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:38587
I20260811 18:58:37.203521 25256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:38587 every 8 connection(s)
I20260811 18:58:37.203837 24999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:37.204830 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 24999
I20260811 18:58:37.204927 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:58:37.205116 6025 external_mini_cluster.cc:1428] Setting key 17fb7dfc4ac1ca381fd734f49eb9d9e9
I20260811 18:58:37.209085 24473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:37.204553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:53935 (local address 127.5.226.126:46561)
0811 18:58:37.204607 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:37.204609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:37.204865 (+ 256us) server_negotiation.cc:407] Connection header received
0811 18:58:37.205486 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:37.205487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:37.205498 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:37.205547 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:37.206409 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:37.206897 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:37.207851 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:37.208033 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:37.208081 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:37.208905 (+ 824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:37.208906 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:37.208906 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:37.208910 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:37.208921 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:37.208924 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:37.208957 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:37.209009 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 18:58:37.209029 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 18:58:37.209329 25265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:37.204524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:46561 (local address 127.5.226.67:53935)
0811 18:58:37.204737 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:37.204771 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:37.205388 (+ 617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:37.205643 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:37.205647 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:37.205659 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:37.206309 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:37.206315 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:37.206971 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:37.206972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:37.207786 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:37.207788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:37.208102 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:37.208103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:37.208230 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:37.208786 (+ 556us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:37.208787 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:37.208818 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:37.208842 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:37.208959 (+ 117us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:37.208962 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:37.208964 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:58:37.209004 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 18:58:37.209084 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":86,"threads_started":1}
I20260811 18:58:37.209825 25260 heartbeater.cc:347] Connected to a master server at 127.5.226.126:46561
I20260811 18:58:37.209914 25260 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:37.210089 25260 heartbeater.cc:511] Master 127.5.226.126:46561 requested a full tablet report, sending...
I20260811 18:58:37.210413 24377 ts_manager.cc:194] Registered new tserver with Master: d8825de25e2d4a72881a00bbd4b203f6 (127.5.226.67:38587)
I20260811 18:58:37.210764 24377 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.226.67:53935
I20260811 18:58:37.216744 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 18:58:37.218595 24473 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:37.218071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39620 (local address 127.5.226.126:46561)
0811 18:58:37.218156 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:37.218159 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:37.218262 (+ 103us) server_negotiation.cc:407] Connection header received
0811 18:58:37.218324 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:37.218325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:37.218339 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:37.218383 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:37.218529 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39620: BlockingRecv error: recv got EOF from 127.0.0.1:39620 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 18:58:37.218647 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 24475
I20260811 18:58:37.238772 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 24720
I20260811 18:58:37.270495 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 24999
I20260811 18:58:37.291715 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 24306
2026-08-11T18:58:37Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (700 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T18:58:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:37Z Disabled control of system clock
I20260811 18:58:37.327032 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:40243
--webserver_interface=127.5.226.126
--webserver_port=0
--builtin_ntp_servers=127.5.226.84:34033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:40243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 18:58:37.408706 25285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:37.408928 25285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:37.408949 25285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:37.410136 25285 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:37.410181 25285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:37.410193 25285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:37.410204 25285 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:37.410214 25285 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:37.411531 25285 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:40243
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:40243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:37.411739 25285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:37.411981 25285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:37.416736 25293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:37.416769 25285 server_base.cc:1034] running on GCE node
W20260811 18:58:37.416724 25291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:37.416728 25295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:37.417181 25285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:37.417518 25285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:37.418655 25285 hybrid_clock.cc:648] HybridClock initialized: now 1786474717418638 us; error 34 us; skew 500 ppm
I20260811 18:58:37.419828 25285 webserver.cc:460] Webserver started at http://127.5.226.126:46383/ using document root <none> and password file <none>
I20260811 18:58:37.420039 25285 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:37.420083 25285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:37.420198 25285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:37.421329 25285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "15981675c2904190b888988f014e322a"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "4fd9472c4d4dda8679fc92925beeadcc"
server_key_iv: "d0475e17151ab1f4c67a03653e150ba7"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.421690 25285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "15981675c2904190b888988f014e322a"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "4fd9472c4d4dda8679fc92925beeadcc"
server_key_iv: "d0475e17151ab1f4c67a03653e150ba7"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.422921 25285 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:37.423614 25307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.423763 25285 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:37.423851 25285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "15981675c2904190b888988f014e322a"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "4fd9472c4d4dda8679fc92925beeadcc"
server_key_iv: "d0475e17151ab1f4c67a03653e150ba7"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.423908 25285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:37.427134 25285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:37.427364 25285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:37.427456 25285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:37.431140 25285 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:40243
I20260811 18:58:37.431173 25425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:40243 every 8 connection(s)
I20260811 18:58:37.431529 25285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:37.432178 25427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:37.434996 25427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a: Bootstrap starting.
I20260811 18:58:37.435520 25427 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:37.435765 25427 log.cc:824] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:37.436415 25427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a: No bootstrap required, opened a new log
I20260811 18:58:37.438045 25427 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15981675c2904190b888988f014e322a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40243 } }
I20260811 18:58:37.438184 25427 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:37.438205 25427 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15981675c2904190b888988f014e322a, State: Initialized, Role: FOLLOWER
I20260811 18:58:37.438323 25427 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15981675c2904190b888988f014e322a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40243 } }
I20260811 18:58:37.438400 25427 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:37.438427 25427 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:37.438460 25427 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:37.438962 25427 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15981675c2904190b888988f014e322a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40243 } }
I20260811 18:58:37.439049 25427 leader_election.cc:302] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15981675c2904190b888988f014e322a; no voters:
I20260811 18:58:37.439174 25427 leader_election.cc:288] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:37.439230 25433 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:37.439386 25433 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [term 1 LEADER]: Becoming Leader. State: Replica: 15981675c2904190b888988f014e322a, State: Running, Role: LEADER
I20260811 18:58:37.439417 25427 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:37.439473 25433 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15981675c2904190b888988f014e322a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40243 } }
I20260811 18:58:37.439841 25436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15981675c2904190b888988f014e322a. Latest consensus state: current_term: 1 leader_uuid: "15981675c2904190b888988f014e322a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15981675c2904190b888988f014e322a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40243 } } }
I20260811 18:58:37.439954 25436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:37.440058 25434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15981675c2904190b888988f014e322a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15981675c2904190b888988f014e322a" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40243 } } }
I20260811 18:58:37.440122 25434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:37.440650 25448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:37.441123 25448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:37.441504 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 25285
I20260811 18:58:37.441606 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:58:37.441817 6025 external_mini_cluster.cc:1428] Setting key 65f36d066767f0ac53d6b8b871c487e6
I20260811 18:58:37.442899 25448 catalog_manager.cc:1347] Generated new cluster ID: 44edf80a6d8743d5a272192fdf2bb5e4
I20260811 18:58:37.442947 25448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:37.444638 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:37.442570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42298 (local address 127.5.226.126:40243)
0811 18:58:37.442758 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:37.442768 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:37.442801 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:58:37.443008 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:37.443016 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:37.443061 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:37.443478 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:37.444052 (+ 574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:37.444056 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:37.444056 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:37.444060 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:37.444098 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:37.444110 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:37.444326 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:37.444359 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 18:58:37.444421 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
I20260811 18:58:37.476321 25448 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:37.476513 25448 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:37.488320 25448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15981675c2904190b888988f014e322a: Generated new TSK 0
I20260811 18:58:37.488540 25448 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:58:37.496394 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40243
--builtin_ntp_servers=127.5.226.84:34033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 18:58:37.580065 25481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:37.580269 25481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:37.580291 25481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:37.581485 25481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:37.581524 25481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:37.581552 25481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:58:37.582916 25481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:37.583145 25481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:37.583425 25481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:58:37.588804 25481 server_base.cc:1034] running on GCE node
W20260811 18:58:37.588760 25500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:37.588759 25497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:37.588760 25493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:37.589180 25481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:37.589488 25481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:37.590624 25481 hybrid_clock.cc:648] HybridClock initialized: now 1786474717590608 us; error 34 us; skew 500 ppm
I20260811 18:58:37.591872 25481 webserver.cc:460] Webserver started at http://127.5.226.65:40431/ using document root <none> and password file <none>
I20260811 18:58:37.592096 25481 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:37.592140 25481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:37.592299 25481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:37.593401 25481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "9d6cac96835b4d748211c6d970567096"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "2a3e6d30b7b23c49e20aa68c9f2e4bda"
server_key_iv: "497515fb3f7d179b84eff5c7081f4bb4"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.593724 25481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "9d6cac96835b4d748211c6d970567096"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "2a3e6d30b7b23c49e20aa68c9f2e4bda"
server_key_iv: "497515fb3f7d179b84eff5c7081f4bb4"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.594913 25481 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:58:37.595619 25517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.595781 25481 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.595870 25481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "9d6cac96835b4d748211c6d970567096"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "2a3e6d30b7b23c49e20aa68c9f2e4bda"
server_key_iv: "497515fb3f7d179b84eff5c7081f4bb4"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.595938 25481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:37.599108 25481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:37.599327 25481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:37.599413 25481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:37.599556 25481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:37.599804 25481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:37.599833 25481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.599851 25481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:37.599869 25481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.605360 25481 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:34909
I20260811 18:58:37.605410 25747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:34909 every 8 connection(s)
I20260811 18:58:37.605705 25481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 18:58:37.608587 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:37.606391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:57759 (local address 127.5.226.126:40243)
0811 18:58:37.606452 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:37.606455 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:37.606651 (+ 196us) server_negotiation.cc:407] Connection header received
0811 18:58:37.607152 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:37.607154 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:37.607164 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:37.607216 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:37.608342 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:37.608344 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:37.608344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:37.608350 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:37.608370 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:37.608375 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:37.608425 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:37.608499 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 18:58:37.608517 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 18:58:37.608768 25750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:37.606357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40243 (local address 127.5.226.65:57759)
0811 18:58:37.606539 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:37.606571 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:37.607049 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:37.607294 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:37.607297 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:37.607305 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:37.608145 (+ 840us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:37.608145 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:37.608175 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:37.608247 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:37.608427 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:37.608433 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:37.608437 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:58:37.608507 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 18:58:37.608571 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":80,"threads_started":1}
I20260811 18:58:37.609258 25748 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40243
I20260811 18:58:37.609372 25748 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:37.609506 25748 heartbeater.cc:511] Master 127.5.226.126:40243 requested a full tablet report, sending...
I20260811 18:58:37.609992 25345 ts_manager.cc:194] Registered new tserver with Master: 9d6cac96835b4d748211c6d970567096 (127.5.226.65:34909)
I20260811 18:58:37.611901 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 25481
I20260811 18:58:37.611982 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:58:37.612135 6025 external_mini_cluster.cc:1428] Setting key 0014471a9d981663c8208ca6b50461f0
I20260811 18:58:37.612960 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40243
--builtin_ntp_servers=127.5.226.84:34033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 18:58:37.694573 25754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:37.694782 25754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:37.694803 25754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:37.695945 25754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:37.695979 25754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:37.696003 25754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:58:37.697364 25754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:37.697573 25754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:37.697849 25754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:37.702762 25764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:37.702904 25765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:37.702836 25754 server_base.cc:1034] running on GCE node
W20260811 18:58:37.702924 25771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:37.703241 25754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:37.703464 25754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:37.704598 25754 hybrid_clock.cc:648] HybridClock initialized: now 1786474717704588 us; error 28 us; skew 500 ppm
I20260811 18:58:37.705816 25754 webserver.cc:460] Webserver started at http://127.5.226.66:43963/ using document root <none> and password file <none>
I20260811 18:58:37.706020 25754 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:37.706069 25754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:37.706197 25754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:37.707266 25754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "70bc2f24bea04563894b6a65c067c6c6"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "f18472c01eb23450d322a2c2a4b7eca5"
server_key_iv: "cbd29f98eda37dcef3cf2393a35eef8c"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.707600 25754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "70bc2f24bea04563894b6a65c067c6c6"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "f18472c01eb23450d322a2c2a4b7eca5"
server_key_iv: "cbd29f98eda37dcef3cf2393a35eef8c"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.708808 25754 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:58:37.709501 25783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.709635 25754 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.709721 25754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "70bc2f24bea04563894b6a65c067c6c6"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "f18472c01eb23450d322a2c2a4b7eca5"
server_key_iv: "cbd29f98eda37dcef3cf2393a35eef8c"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.709796 25754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:37.712982 25754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:37.713233 25754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:37.713371 25754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:37.713563 25754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:37.713851 25754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:37.713884 25754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.713909 25754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:37.713933 25754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.719440 25754 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:44463
I20260811 18:58:37.719483 26030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:44463 every 8 connection(s)
I20260811 18:58:37.719796 25754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 18:58:37.722620 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:37.720479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:52295 (local address 127.5.226.126:40243)
0811 18:58:37.720559 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:37.720561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:37.720737 (+ 176us) server_negotiation.cc:407] Connection header received
0811 18:58:37.721212 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:37.721214 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:37.721219 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:37.721266 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:37.722424 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:37.722425 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:37.722426 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:37.722430 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:37.722450 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:37.722454 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:37.722503 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:37.722552 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 18:58:37.722565 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 18:58:37.722805 26034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:37.720451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40243 (local address 127.5.226.66:52295)
0811 18:58:37.720628 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:37.720662 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:37.721128 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:37.721397 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:37.721400 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:37.721410 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:37.722270 (+ 860us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:37.722270 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:37.722301 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:37.722330 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:37.722502 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:37.722504 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:37.722506 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:58:37.722556 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 18:58:37.722603 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":91,"threads_started":1}
I20260811 18:58:37.723299 26032 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40243
I20260811 18:58:37.723382 26032 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:37.723500 26032 heartbeater.cc:511] Master 127.5.226.126:40243 requested a full tablet report, sending...
I20260811 18:58:37.723803 25345 ts_manager.cc:194] Registered new tserver with Master: 70bc2f24bea04563894b6a65c067c6c6 (127.5.226.66:44463)
I20260811 18:58:37.728060 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 25754
I20260811 18:58:37.728139 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:58:37.728325 6025 external_mini_cluster.cc:1428] Setting key dbae58ea34981e7af90888e88e9dc68f
I20260811 18:58:37.729183 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40243
--builtin_ntp_servers=127.5.226.84:34033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 18:58:37.809827 26038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:37.810045 26038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:37.810074 26038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:37.811233 26038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:37.811273 26038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:37.811313 26038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:58:37.812666 26038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:37.812917 26038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:37.813200 26038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:37.817984 26054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:37.818027 26052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:37.818027 26046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:37.818156 26038 server_base.cc:1034] running on GCE node
I20260811 18:58:37.818400 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:37.818638 26038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:37.819782 26038 hybrid_clock.cc:648] HybridClock initialized: now 1786474717819771 us; error 27 us; skew 500 ppm
I20260811 18:58:37.821002 26038 webserver.cc:460] Webserver started at http://127.5.226.67:37003/ using document root <none> and password file <none>
I20260811 18:58:37.821221 26038 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:37.821269 26038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:37.821419 26038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:37.822461 26038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "2eda40efe4b04a61912eab6f97f172e4"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "80864f71bdf31aa67f756e5ebcd7ee4a"
server_key_iv: "53b83ad0901a7532470fee024b901d6b"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.822809 26038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "2eda40efe4b04a61912eab6f97f172e4"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "80864f71bdf31aa67f756e5ebcd7ee4a"
server_key_iv: "53b83ad0901a7532470fee024b901d6b"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.823982 26038 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:58:37.824615 26063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.824775 26038 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:37.824862 26038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "2eda40efe4b04a61912eab6f97f172e4"
format_stamp: "Formatted at 2026-08-11 18:58:37 on dist-test-slave-gjw7"
server_key: "80864f71bdf31aa67f756e5ebcd7ee4a"
server_key_iv: "53b83ad0901a7532470fee024b901d6b"
server_key_version: "encryptionkey@0"
I20260811 18:58:37.824915 26038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:37.828166 26038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:37.828373 26038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:37.828460 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:37.828614 26038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:37.828893 26038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:37.828925 26038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.828944 26038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:37.828966 26038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:37.834316 26038 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:35993
I20260811 18:58:37.834376 26301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:35993 every 8 connection(s)
I20260811 18:58:37.834638 26038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:37.837414 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:37.835291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:55769 (local address 127.5.226.126:40243)
0811 18:58:37.835341 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:37.835343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:37.835576 (+ 233us) server_negotiation.cc:407] Connection header received
0811 18:58:37.836031 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:37.836032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:37.836039 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:37.836089 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:37.837113 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:37.837115 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:37.837115 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:37.837120 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:37.837139 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:37.837144 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:37.837248 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:37.837333 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 18:58:37.837351 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 18:58:37.837571 26313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:37.835300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40243 (local address 127.5.226.67:55769)
0811 18:58:37.835482 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:37.835512 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:37.835945 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:37.836141 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:37.836144 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:37.836152 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:37.836954 (+ 802us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:37.836955 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:37.836981 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:37.837009 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:37.837244 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:37.837247 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:37.837249 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:58:37.837338 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 18:58:37.837391 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":92,"threads_started":1}
I20260811 18:58:37.838045 26306 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40243
I20260811 18:58:37.838140 26306 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:37.838265 26306 heartbeater.cc:511] Master 127.5.226.126:40243 requested a full tablet report, sending...
I20260811 18:58:37.838610 25345 ts_manager.cc:194] Registered new tserver with Master: 2eda40efe4b04a61912eab6f97f172e4 (127.5.226.67:35993)
I20260811 18:58:37.844424 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 26038
I20260811 18:58:37.844529 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:58:37.844735 6025 external_mini_cluster.cc:1428] Setting key aaac655b97d9308c555f447496fdc460
I20260811 18:58:37.845539 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 18:58:37.847196 25480 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:58:37.846803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42300 (local address 127.5.226.126:40243)
0811 18:58:37.846848 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:37.846850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:37.846938 (+ 88us) server_negotiation.cc:407] Connection header received
0811 18:58:37.846980 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:37.846981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:37.846985 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:37.847032 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:37.847134 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42300: BlockingRecv error: recv got EOF from 127.0.0.1:42300 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:58:37.847287 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 25481
I20260811 18:58:37.867089 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 25754
I20260811 18:58:37.880358 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 26038
I20260811 18:58:37.894066 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 25285
2026-08-11T18:58:37Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (601 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:58:37 dist-test-slave-gjw7 krb5kdc[26331](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:58:37 dist-test-slave-gjw7 krb5kdc[26331](info): set up 2 sockets
Aug 11 18:58:37 dist-test-slave-gjw7 krb5kdc[26331](info): commencing operation
krb5kdc: starting...
W20260811 18:58:39.108233 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:58:39 dist-test-slave-gjw7 krb5kdc[26331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:58:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 18:58:39.228010 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:36871
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:44377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:36871
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:39.310741 26357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:39.310967 26357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:39.310997 26357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:39.312187 26357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:39.312233 26357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:39.312250 26357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:39.312266 26357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:39.312281 26357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:39.313835 26357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:44377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:36871
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:36871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:39.314092 26357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:39.314299 26357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:39.318943 26373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:39.318944 26368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:39.318970 26366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:39.319051 26357 server_base.cc:1034] running on GCE node
I20260811 18:58:39.319411 26357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:39.319728 26357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:39.320873 26357 hybrid_clock.cc:648] HybridClock initialized: now 1786474719320856 us; error 34 us; skew 500 ppm
Aug 11 18:58:39 dist-test-slave-gjw7 krb5kdc[26331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474719, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:39.323385 26357 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 18:58:39.323839 26357 webserver.cc:460] Webserver started at http://127.5.226.126:35037/ using document root <none> and password file <none>
I20260811 18:58:39.324059 26357 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:39.324108 26357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:39.324235 26357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:39.325281 26357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "ea12b6b6cce1429eb23d010b392d1c9d"
format_stamp: "Formatted at 2026-08-11 18:58:39 on dist-test-slave-gjw7"
server_key: "7e626bc3710976272a535e836172aa8a"
server_key_iv: "426160f97a176823533a61840748f133"
server_key_version: "encryptionkey@0"
I20260811 18:58:39.325685 26357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "ea12b6b6cce1429eb23d010b392d1c9d"
format_stamp: "Formatted at 2026-08-11 18:58:39 on dist-test-slave-gjw7"
server_key: "7e626bc3710976272a535e836172aa8a"
server_key_iv: "426160f97a176823533a61840748f133"
server_key_version: "encryptionkey@0"
I20260811 18:58:39.326958 26357 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:58:39.327649 26386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:39.327824 26357 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:39.327913 26357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "ea12b6b6cce1429eb23d010b392d1c9d"
format_stamp: "Formatted at 2026-08-11 18:58:39 on dist-test-slave-gjw7"
server_key: "7e626bc3710976272a535e836172aa8a"
server_key_iv: "426160f97a176823533a61840748f133"
server_key_version: "encryptionkey@0"
I20260811 18:58:39.327980 26357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:39.336467 26357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:39.338541 26357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:39.338681 26357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:39.342604 26357 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:36871
I20260811 18:58:39.342644 26500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:36871 every 8 connection(s)
I20260811 18:58:39.342989 26357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:39.343954 26501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:39.346441 26501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d: Bootstrap starting.
I20260811 18:58:39.347043 26501 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:39.347337 26501 log.cc:824] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:39.348101 26501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d: No bootstrap required, opened a new log
I20260811 18:58:39.349905 26501 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea12b6b6cce1429eb23d010b392d1c9d" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36871 } }
I20260811 18:58:39.350057 26501 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:39.350082 26501 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea12b6b6cce1429eb23d010b392d1c9d, State: Initialized, Role: FOLLOWER
I20260811 18:58:39.350243 26501 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea12b6b6cce1429eb23d010b392d1c9d" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36871 } }
I20260811 18:58:39.350317 26501 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:39.350344 26501 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:39.350395 26501 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:39.351229 26501 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea12b6b6cce1429eb23d010b392d1c9d" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36871 } }
I20260811 18:58:39.351332 26501 leader_election.cc:302] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea12b6b6cce1429eb23d010b392d1c9d; no voters:
I20260811 18:58:39.351497 26501 leader_election.cc:288] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:39.351544 26518 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:39.351692 26518 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [term 1 LEADER]: Becoming Leader. State: Replica: ea12b6b6cce1429eb23d010b392d1c9d, State: Running, Role: LEADER
I20260811 18:58:39.351758 26501 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:39.351795 26518 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea12b6b6cce1429eb23d010b392d1c9d" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36871 } }
I20260811 18:58:39.352174 26520 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea12b6b6cce1429eb23d010b392d1c9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea12b6b6cce1429eb23d010b392d1c9d" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36871 } } }
I20260811 18:58:39.352191 26521 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea12b6b6cce1429eb23d010b392d1c9d. Latest consensus state: current_term: 1 leader_uuid: "ea12b6b6cce1429eb23d010b392d1c9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea12b6b6cce1429eb23d010b392d1c9d" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36871 } } }
I20260811 18:58:39.352375 26521 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:39.352757 26532 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:39.352787 26520 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:39.352990 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 26357
I20260811 18:58:39.353083 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:58:39.353328 6025 external_mini_cluster.cc:1428] Setting key 544841e95b235c0d007974a94b5880a0
I20260811 18:58:39.353350 26532 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:39.355129 26532 catalog_manager.cc:1347] Generated new cluster ID: 6db070054d8444afae94a0d608571098
I20260811 18:58:39.355183 26532 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:39.360267 26532 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:39.360904 26532 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:39.364233 26532 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d: Generated new TSK 0
I20260811 18:58:39.364391 26532 catalog_manager.cc:1514] Initializing in-progress tserver states...
Aug 11 18:58:39 dist-test-slave-gjw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:39.369374 26552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.353839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50250 (local address 127.5.226.126:36871)
0811 18:58:39.354034 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:39.354043 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:39.354080 (+ 37us) server_negotiation.cc:407] Connection header received
0811 18:58:39.354210 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:39.354216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:39.354260 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:39.354384 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:39.359871 (+ 5487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.361607 (+ 1736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.362653 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.363266 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.363360 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:39.366304 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:39.366308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:39.366309 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:39.366320 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:39.367885 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:39.368293 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:39.368295 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:39.368295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:39.368382 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:39.368566 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:39.368567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:39.368567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:39.368760 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:39.368854 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:39.368994 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 18:58:39.369105 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":97,"threads_started":1}
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 18:58:39.395887 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:36871
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:44377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:39.478622 26559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:39.478842 26559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:39.478876 26559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:39.480077 26559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:39.480122 26559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:39.480155 26559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:58:39.481719 26559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:44377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:36871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:39.481968 26559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:39.482183 26559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:39.486984 26576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:39.486968 26583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:39.486968 26571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:39.487054 26559 server_base.cc:1034] running on GCE node
I20260811 18:58:39.487385 26559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:39.487617 26559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:39.488766 26559 hybrid_clock.cc:648] HybridClock initialized: now 1786474719488753 us; error 30 us; skew 500 ppm
Aug 11 18:58:39 dist-test-slave-gjw7 krb5kdc[26331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474719, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:39.495126 26559 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 18:58:39.495636 26559 webserver.cc:460] Webserver started at http://127.5.226.65:39421/ using document root <none> and password file <none>
I20260811 18:58:39.495880 26559 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:39.495950 26559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:39.496088 26559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:39.497192 26559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "e2a1b95cdc4b4537adae26bfb98d48c9"
format_stamp: "Formatted at 2026-08-11 18:58:39 on dist-test-slave-gjw7"
server_key: "746f482821bf29a230fe229a612eedf8"
server_key_iv: "6d1e84d06ae11691ba80300e337a62f3"
server_key_version: "encryptionkey@0"
I20260811 18:58:39.497596 26559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "e2a1b95cdc4b4537adae26bfb98d48c9"
format_stamp: "Formatted at 2026-08-11 18:58:39 on dist-test-slave-gjw7"
server_key: "746f482821bf29a230fe229a612eedf8"
server_key_iv: "6d1e84d06ae11691ba80300e337a62f3"
server_key_version: "encryptionkey@0"
I20260811 18:58:39.498989 26559 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:39.499738 26598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:39.499898 26559 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:58:39.499987 26559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "e2a1b95cdc4b4537adae26bfb98d48c9"
format_stamp: "Formatted at 2026-08-11 18:58:39 on dist-test-slave-gjw7"
server_key: "746f482821bf29a230fe229a612eedf8"
server_key_iv: "6d1e84d06ae11691ba80300e337a62f3"
server_key_version: "encryptionkey@0"
I20260811 18:58:39.500051 26559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:39.515612 26559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:39.517777 26559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:39.517925 26559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:39.518142 26559 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:39.518445 26559 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:39.518481 26559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:39.518509 26559 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:39.518527 26559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:39.524147 26559 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:33451
I20260811 18:58:39.524204 26822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:33451 every 8 connection(s)
I20260811 18:58:39.524506 26559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
Aug 11 18:58:39 dist-test-slave-gjw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474719, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:39.531433 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 26559
I20260811 18:58:39.531527 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:58:39.531740 6025 external_mini_cluster.cc:1428] Setting key 5e4562020b9503881ad408b04b04c7d2
I20260811 18:58:39.533032 26552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.525199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:56991 (local address 127.5.226.126:36871)
0811 18:58:39.525267 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:39.525269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:39.525502 (+ 233us) server_negotiation.cc:407] Connection header received
0811 18:58:39.525990 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:39.525991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:39.526002 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:39.526052 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:39.526948 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.527445 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.528352 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.528539 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.528582 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:39.530552 (+ 1970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:39.530554 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:39.530554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:39.530561 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:39.531762 (+ 1201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:39.532137 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:39.532138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:39.532138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:39.532200 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:39.532421 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:39.532421 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:39.532422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:39.532536 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:39.532594 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:39.532849 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 18:58:39.532944 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 18:58:39.533186 26825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.525172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:36871 (local address 127.5.226.65:56991)
0811 18:58:39.525384 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:39.525422 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:39.525909 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:39.526114 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:39.526118 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:39.526676 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:39.526875 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:39.526881 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.527509 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.527509 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:39.528288 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:39.528290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.528591 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.528591 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:39.528687 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:39.529092 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:39.529100 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:39.530477 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:39.531851 (+ 1374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:39.531859 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:39.531861 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:39.532068 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:39.532255 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:39.532255 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:39.532255 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:39.532362 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:39.532591 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:39.532598 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:39.532729 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 18:58:39.532818 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 18:58:39.532978 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":87,"threads_started":1}
I20260811 18:58:39.533639 26823 heartbeater.cc:347] Connected to a master server at 127.5.226.126:36871
I20260811 18:58:39.533744 26823 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:39.533939 26823 heartbeater.cc:511] Master 127.5.226.126:36871 requested a full tablet report, sending...
I20260811 18:58:39.534519 26426 ts_manager.cc:194] Registered new tserver with Master: e2a1b95cdc4b4537adae26bfb98d48c9 (127.5.226.65:33451)
I20260811 18:58:39.535358 26426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:56991
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 18:58:39.557626 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:36871
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:44377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:39.639822 26828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:39.640026 26828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:39.640058 26828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:39.641175 26828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:39.641225 26828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:39.641266 26828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:58:39.642740 26828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:44377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:36871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:39.642997 26828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:39.643208 26828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:39.648170 26840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:39.648195 26845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:39.648188 26838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:39.648221 26828 server_base.cc:1034] running on GCE node
I20260811 18:58:39.648547 26828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:39.648797 26828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:39.649935 26828 hybrid_clock.cc:648] HybridClock initialized: now 1786474719649923 us; error 30 us; skew 500 ppm
Aug 11 18:58:39 dist-test-slave-gjw7 krb5kdc[26331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474719, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:39.652416 26828 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 18:58:39.652854 26828 webserver.cc:460] Webserver started at http://127.5.226.66:44625/ using document root <none> and password file <none>
I20260811 18:58:39.653106 26828 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:39.653156 26828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:39.653281 26828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:39.654371 26828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "1cc4a897149f44609113a5c5ab9ae2c0"
format_stamp: "Formatted at 2026-08-11 18:58:39 on dist-test-slave-gjw7"
server_key: "c4f378e386bd5f36381d0a63ebe48bcd"
server_key_iv: "a91e6738ee5f154ff3ef5972d01b70a2"
server_key_version: "encryptionkey@0"
I20260811 18:58:39.654716 26828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "1cc4a897149f44609113a5c5ab9ae2c0"
format_stamp: "Formatted at 2026-08-11 18:58:39 on dist-test-slave-gjw7"
server_key: "c4f378e386bd5f36381d0a63ebe48bcd"
server_key_iv: "a91e6738ee5f154ff3ef5972d01b70a2"
server_key_version: "encryptionkey@0"
I20260811 18:58:39.656002 26828 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:58:39.656759 26858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:39.656915 26828 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:58:39.657004 26828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "1cc4a897149f44609113a5c5ab9ae2c0"
format_stamp: "Formatted at 2026-08-11 18:58:39 on dist-test-slave-gjw7"
server_key: "c4f378e386bd5f36381d0a63ebe48bcd"
server_key_iv: "a91e6738ee5f154ff3ef5972d01b70a2"
server_key_version: "encryptionkey@0"
I20260811 18:58:39.657063 26828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:39.671608 26828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:39.673419 26828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:39.673565 26828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:39.673843 26828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:39.674181 26828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:39.674220 26828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:39.674252 26828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:39.674273 26828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:39.679983 26828 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:41091
I20260811 18:58:39.680044 27092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:41091 every 8 connection(s)
I20260811 18:58:39.680349 26828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 18:58:39.682529 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 26828
I20260811 18:58:39.682621 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:58:39.682797 6025 external_mini_cluster.cc:1428] Setting key eed952c9ac97751c12372049c1cea1e7
Aug 11 18:58:39 dist-test-slave-gjw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474719, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:39.690146 26552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.681072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:48373 (local address 127.5.226.126:36871)
0811 18:58:39.681135 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:39.681137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:39.681312 (+ 175us) server_negotiation.cc:407] Connection header received
0811 18:58:39.681840 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:39.681841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:39.681850 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:39.681909 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:39.682884 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.683494 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.684916 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.685105 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.685167 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:39.687446 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:39.687448 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:39.687449 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:39.687458 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:39.688788 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:39.689199 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:39.689200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:39.689201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:39.689260 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:39.689509 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:39.689509 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:39.689510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:39.689624 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:39.689681 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:39.689966 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 18:58:39.690057 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 18:58:39.690310 27099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.681027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:36871 (local address 127.5.226.66:48373)
0811 18:58:39.681183 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:39.681226 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:39.681756 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:39.681967 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:39.681970 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:39.682549 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:39.682783 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:39.682790 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.683606 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.683607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:39.684823 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:39.684827 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.685202 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.685204 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:39.685363 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:39.685850 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:39.685858 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:39.687340 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:39.688865 (+ 1525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:39.688895 (+ 30us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:39.688898 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:39.689129 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:39.689331 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:39.689332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:39.689332 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:39.689450 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:39.689679 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:39.689687 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:39.689821 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 18:58:39.689934 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 18:58:39.690092 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
I20260811 18:58:39.690805 27093 heartbeater.cc:347] Connected to a master server at 127.5.226.126:36871
I20260811 18:58:39.690913 27093 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:39.691116 27093 heartbeater.cc:511] Master 127.5.226.126:36871 requested a full tablet report, sending...
I20260811 18:58:39.691532 26426 ts_manager.cc:194] Registered new tserver with Master: 1cc4a897149f44609113a5c5ab9ae2c0 (127.5.226.66:41091)
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
I20260811 18:58:39.692032 26426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:48373
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 18:58:39.707829 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:36871
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:44377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:39.788664 27104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:39.788862 27104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:39.788883 27104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:39.790055 27104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:39.790096 27104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:39.790120 27104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:58:39.791564 27104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:44377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:36871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:58:39.791778 27104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:39.792003 27104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:39.796895 27114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:39.796911 27111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:39.796917 27119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:39.796976 27104 server_base.cc:1034] running on GCE node
I20260811 18:58:39.797379 27104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:39.797601 27104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:39.798744 27104 hybrid_clock.cc:648] HybridClock initialized: now 1786474719798731 us; error 29 us; skew 500 ppm
Aug 11 18:58:39 dist-test-slave-gjw7 krb5kdc[26331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474719, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:39.801239 27104 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 18:58:39.801717 27104 webserver.cc:460] Webserver started at http://127.5.226.67:35221/ using document root <none> and password file <none>
I20260811 18:58:39.801954 27104 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:39.801999 27104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:39.802117 27104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:39.803265 27104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "9fe0417d860f4bde8c4add32ecde17b5"
format_stamp: "Formatted at 2026-08-11 18:58:39 on dist-test-slave-gjw7"
server_key: "497ce4cb58c720e481295adbd5df3850"
server_key_iv: "739435a981785d0440e0c5038702d5dd"
server_key_version: "encryptionkey@0"
I20260811 18:58:39.803620 27104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "9fe0417d860f4bde8c4add32ecde17b5"
format_stamp: "Formatted at 2026-08-11 18:58:39 on dist-test-slave-gjw7"
server_key: "497ce4cb58c720e481295adbd5df3850"
server_key_iv: "739435a981785d0440e0c5038702d5dd"
server_key_version: "encryptionkey@0"
I20260811 18:58:39.804891 27104 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:58:39.805634 27135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:39.805806 27104 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:58:39.805884 27104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "9fe0417d860f4bde8c4add32ecde17b5"
format_stamp: "Formatted at 2026-08-11 18:58:39 on dist-test-slave-gjw7"
server_key: "497ce4cb58c720e481295adbd5df3850"
server_key_iv: "739435a981785d0440e0c5038702d5dd"
server_key_version: "encryptionkey@0"
I20260811 18:58:39.805950 27104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:39.821484 27104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:39.823707 27104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:39.823859 27104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:39.824102 27104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:39.824416 27104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:39.824452 27104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:39.824482 27104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:39.824505 27104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:39.830389 27104 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:39233
I20260811 18:58:39.830448 27347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:39233 every 8 connection(s)
I20260811 18:58:39.830744 27104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:39.833001 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 27104
I20260811 18:58:39.833086 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:58:39.833261 6025 external_mini_cluster.cc:1428] Setting key 6356cee172ed0aceab0370f1fff5127a
Aug 11 18:58:39 dist-test-slave-gjw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474719, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:58:39.839788 26552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.831438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:50323 (local address 127.5.226.126:36871)
0811 18:58:39.831497 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:39.831499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:39.831692 (+ 193us) server_negotiation.cc:407] Connection header received
0811 18:58:39.832241 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:39.832242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:39.832255 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:39.832308 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:39.833359 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.834027 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.834997 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.835200 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.835254 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:39.837381 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:39.837382 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:39.837383 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:39.837391 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:39.838526 (+ 1135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:39.838895 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:39.838897 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:39.838897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:39.838959 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:39.839176 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:39.839177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:39.839177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:39.839296 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:39.839352 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:39.839616 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 18:58:39.839699 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 18:58:39.839972 27355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.831394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:36871 (local address 127.5.226.67:50323)
0811 18:58:39.831566 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:39.831613 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:39.832133 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:39.832380 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:39.832384 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:39.832994 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:39.833245 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:39.833252 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.834104 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.834106 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:39.834914 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:39.834917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.835267 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.835268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:39.835395 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:39.835864 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:39.835873 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:39.837274 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:39.838599 (+ 1325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:39.838606 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:39.838609 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:39.838829 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:39.839012 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:39.839013 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:39.839013 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:39.839121 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:39.839353 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:39.839361 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:39.839496 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 18:58:39.839583 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:58:39.839737 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":85,"threads_started":1}
I20260811 18:58:39.840400 27348 heartbeater.cc:347] Connected to a master server at 127.5.226.126:36871
I20260811 18:58:39.840498 27348 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:39.840678 27348 heartbeater.cc:511] Master 127.5.226.126:36871 requested a full tablet report, sending...
I20260811 18:58:39.841045 26426 ts_manager.cc:194] Registered new tserver with Master: 9fe0417d860f4bde8c4add32ecde17b5 (127.5.226.67:39233)
I20260811 18:58:39.841485 26426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:50323
I20260811 18:58:39.844990 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:58:39.852044 26552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.846371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38238 (local address 127.5.226.126:36871)
0811 18:58:39.846423 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:39.846425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:39.846539 (+ 114us) server_negotiation.cc:407] Connection header received
0811 18:58:39.846601 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:39.846602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:39.846613 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:39.846660 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:39.847211 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.847675 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.848388 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.848577 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.848630 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:39.849841 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:39.849842 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:39.849842 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:39.849850 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:39.850933 (+ 1083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:39.851251 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:39.851252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:39.851252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:39.851305 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:39.851468 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:39.851468 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:39.851468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:39.851634 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:39.851719 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:39.851851 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 18:58:39.851927 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 18:58:39.853662 26426 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38238:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:58:39.855175 26426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:58:39.861464 27365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.857118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:41091 (local address 127.0.0.1:36652)
0811 18:58:39.857584 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:39.857627 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:39.857705 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:39.858249 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:39.858250 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:39.858252 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:39.858294 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:39.858296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.859464 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.859465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:39.860401 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:39.860404 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.861161 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.861162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:39.861240 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:39.861255 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 18:58:39.861338 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 18:58:39.861388 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":57,"threads_started":1}
I20260811 18:58:39.861567 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.857124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:33451 (local address 127.0.0.1:53610)
0811 18:58:39.857802 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:39.857810 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:39.857850 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:39.858093 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:39.858094 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:39.858096 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:39.858152 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:39.858154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.859073 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.859074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:39.860421 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:39.860425 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.861375 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.861376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:39.861429 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:39.861432 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:58:39.861476 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 18:58:39.861509 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"mutex_wait_us":27,"thread_start_us":61,"threads_started":1}
I20260811 18:58:39.861717 27370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.857405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53610 (local address 127.5.226.65:33451)
0811 18:58:39.857666 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:39.857670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:39.857869 (+ 199us) server_negotiation.cc:407] Connection header received
0811 18:58:39.857914 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:39.857916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:39.857930 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:39.858001 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:39.858231 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.858977 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.860524 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.861275 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.861376 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:39.861438 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:39.861501 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 18:58:39.861541 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":88,"threads_started":1}
I20260811 18:58:39.861794 27368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.857240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36652 (local address 127.5.226.66:41091)
0811 18:58:39.857623 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:39.857626 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:39.857709 (+ 83us) server_negotiation.cc:407] Connection header received
0811 18:58:39.858024 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:39.858026 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:39.858040 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:39.858124 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:39.858379 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.859380 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.860474 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.861087 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.861150 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:39.861223 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:39.861659 (+ 436us) server_negotiation.cc:299] Negotiation successful
0811 18:58:39.861717 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":117,"threads_started":1}
I20260811 18:58:39.861871 27367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.857124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:39233 (local address 127.0.0.1:47872)
0811 18:58:39.857590 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:39.857627 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:39.857705 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:39.857897 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:39.857900 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:39.857902 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:39.857964 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:39.857966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.859227 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.859228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:39.860422 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:39.860425 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.861664 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.861665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:39.861720 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:39.861723 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:58:39.861770 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 18:58:39.861803 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"mutex_wait_us":5,"thread_start_us":60,"threads_started":1}
I20260811 18:58:39.862118 27373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.857393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47872 (local address 127.5.226.67:39233)
0811 18:58:39.857587 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:39.857592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:39.857686 (+ 94us) server_negotiation.cc:407] Connection header received
0811 18:58:39.857800 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:39.857802 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:39.857816 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:39.857888 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:39.858024 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.859121 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.860524 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:39.861283 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:39.861376 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:39.861437 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:39.861997 (+ 560us) server_negotiation.cc:299] Negotiation successful
0811 18:58:39.862043 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":102,"threads_started":1}
I20260811 18:58:39.862426 26704 tablet_service.cc:1467] Processing CreateTablet for tablet d331b4658c8347a9b00fec05eeaf25df (DEFAULT_TABLE table=test-table [id=e666454aceb5412eaa086abed164e478]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:39.862823 26704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d331b4658c8347a9b00fec05eeaf25df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:39.862771 27221 tablet_service.cc:1467] Processing CreateTablet for tablet d331b4658c8347a9b00fec05eeaf25df (DEFAULT_TABLE table=test-table [id=e666454aceb5412eaa086abed164e478]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:39.863073 27221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d331b4658c8347a9b00fec05eeaf25df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:39.865796 27376 tablet_bootstrap.cc:492] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9: Bootstrap starting.
I20260811 18:58:39.865801 27377 tablet_bootstrap.cc:492] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5: Bootstrap starting.
I20260811 18:58:39.865749 26965 tablet_service.cc:1467] Processing CreateTablet for tablet d331b4658c8347a9b00fec05eeaf25df (DEFAULT_TABLE table=test-table [id=e666454aceb5412eaa086abed164e478]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:39.866048 26965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d331b4658c8347a9b00fec05eeaf25df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:39.866470 27376 tablet_bootstrap.cc:654] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:39.866470 27377 tablet_bootstrap.cc:654] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:39.867031 27376 log.cc:824] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:39.867019 27377 log.cc:824] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:39.867765 27376 tablet_bootstrap.cc:492] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9: No bootstrap required, opened a new log
I20260811 18:58:39.867772 27377 tablet_bootstrap.cc:492] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5: No bootstrap required, opened a new log
I20260811 18:58:39.867837 27376 ts_tablet_manager.cc:1397] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:58:39.867837 27377 ts_tablet_manager.cc:1397] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:58:39.868547 27381 tablet_bootstrap.cc:492] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0: Bootstrap starting.
I20260811 18:58:39.869169 27381 tablet_bootstrap.cc:654] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:39.869781 27381 log.cc:824] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:39.869798 27377 raft_consensus.cc:348] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc4a897149f44609113a5c5ab9ae2c0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41091 } } peers { permanent_uuid: "9fe0417d860f4bde8c4add32ecde17b5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39233 } } peers { permanent_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33451 } }
I20260811 18:58:39.869798 27376 raft_consensus.cc:348] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc4a897149f44609113a5c5ab9ae2c0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41091 } } peers { permanent_uuid: "9fe0417d860f4bde8c4add32ecde17b5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39233 } } peers { permanent_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33451 } }
I20260811 18:58:39.869967 27376 raft_consensus.cc:374] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:39.869967 27377 raft_consensus.cc:374] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:39.870015 27377 raft_consensus.cc:729] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe0417d860f4bde8c4add32ecde17b5, State: Initialized, Role: FOLLOWER
I20260811 18:58:39.870015 27376 raft_consensus.cc:729] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a1b95cdc4b4537adae26bfb98d48c9, State: Initialized, Role: FOLLOWER
I20260811 18:58:39.870142 27376 consensus_queue.cc:260] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc4a897149f44609113a5c5ab9ae2c0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41091 } } peers { permanent_uuid: "9fe0417d860f4bde8c4add32ecde17b5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39233 } } peers { permanent_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33451 } }
I20260811 18:58:39.870142 27377 consensus_queue.cc:260] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc4a897149f44609113a5c5ab9ae2c0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41091 } } peers { permanent_uuid: "9fe0417d860f4bde8c4add32ecde17b5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39233 } } peers { permanent_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33451 } }
I20260811 18:58:39.870437 27377 ts_tablet_manager.cc:1428] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:58:39.870438 27376 ts_tablet_manager.cc:1428] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:58:39.870479 26823 heartbeater.cc:503] Master 127.5.226.126:36871 was elected leader, sending a full tablet report...
I20260811 18:58:39.870558 27348 heartbeater.cc:503] Master 127.5.226.126:36871 was elected leader, sending a full tablet report...
I20260811 18:58:39.870746 27381 tablet_bootstrap.cc:492] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0: No bootstrap required, opened a new log
I20260811 18:58:39.870844 27381 ts_tablet_manager.cc:1397] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:58:39.872448 27381 raft_consensus.cc:348] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc4a897149f44609113a5c5ab9ae2c0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41091 } } peers { permanent_uuid: "9fe0417d860f4bde8c4add32ecde17b5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39233 } } peers { permanent_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33451 } }
I20260811 18:58:39.872576 27381 raft_consensus.cc:374] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:39.872607 27381 raft_consensus.cc:729] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc4a897149f44609113a5c5ab9ae2c0, State: Initialized, Role: FOLLOWER
I20260811 18:58:39.872718 27381 consensus_queue.cc:260] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc4a897149f44609113a5c5ab9ae2c0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41091 } } peers { permanent_uuid: "9fe0417d860f4bde8c4add32ecde17b5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39233 } } peers { permanent_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33451 } }
I20260811 18:58:39.872965 27381 ts_tablet_manager.cc:1428] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:58:39.873049 27093 heartbeater.cc:503] Master 127.5.226.126:36871 was elected leader, sending a full tablet report...
W20260811 18:58:39.930939 27097 tablet.cc:2369] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:58:40.025316 26824 tablet.cc:2369] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:58:40.081329 27349 tablet.cc:2369] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:58:40.120112 27387 raft_consensus.cc:482] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:40.120245 27387 raft_consensus.cc:504] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc4a897149f44609113a5c5ab9ae2c0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41091 } } peers { permanent_uuid: "9fe0417d860f4bde8c4add32ecde17b5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39233 } } peers { permanent_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33451 } }
I20260811 18:58:40.120652 27387 leader_election.cc:288] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cc4a897149f44609113a5c5ab9ae2c0 (127.5.226.66:41091), 9fe0417d860f4bde8c4add32ecde17b5 (127.5.226.67:39233)
I20260811 18:58:40.123528 27368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:40.120901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:35597 (local address 127.5.226.66:41091)
0811 18:58:40.120959 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:40.120962 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:40.121064 (+ 102us) server_negotiation.cc:407] Connection header received
0811 18:58:40.121134 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:40.121135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:40.121144 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:40.121194 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:40.121378 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:40.121852 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:40.122826 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:40.123211 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:40.123273 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:40.123284 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:40.123422 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 18:58:40.123459 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 18:58:40.123536 27373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:40.121020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:47307 (local address 127.5.226.67:39233)
0811 18:58:40.121092 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:40.121095 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:40.121157 (+ 62us) server_negotiation.cc:407] Connection header received
0811 18:58:40.121234 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:40.121235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:40.121244 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:40.121307 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:40.121451 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:40.121919 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:40.122858 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:40.123235 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:40.123296 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:40.123305 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:40.123433 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 18:58:40.123468 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 18:58:40.123551 27396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:40.120835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:41091 (local address 127.5.226.65:35597)
0811 18:58:40.120985 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:40.120996 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:40.121074 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:40.121211 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:40.121212 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:40.121214 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:40.121313 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:40.121316 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:40.121937 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:40.121938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:40.122739 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:40.122741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:40.123288 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:40.123289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:40.123363 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:40.123366 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:58:40.123411 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 18:58:40.123454 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":31,"thread_start_us":69,"threads_started":1}
I20260811 18:58:40.123560 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:40.120835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:39233 (local address 127.5.226.65:47307)
0811 18:58:40.121084 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:40.121094 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:40.121161 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:40.121319 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:40.121320 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:40.121322 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:40.121394 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:40.121396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:40.121999 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:40.122000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:40.122777 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:40.122780 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:40.123312 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:40.123312 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:40.123375 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:40.123378 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:58:40.123422 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 18:58:40.123465 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":4,"thread_start_us":62,"threads_started":1}
I20260811 18:58:40.123905 27260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d331b4658c8347a9b00fec05eeaf25df" candidate_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe0417d860f4bde8c4add32ecde17b5" is_pre_election: true
I20260811 18:58:40.124047 27260 raft_consensus.cc:2454] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a1b95cdc4b4537adae26bfb98d48c9 in term 0.
I20260811 18:58:40.124161 27004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d331b4658c8347a9b00fec05eeaf25df" candidate_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc4a897149f44609113a5c5ab9ae2c0" is_pre_election: true
I20260811 18:58:40.124266 26599 leader_election.cc:302] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe0417d860f4bde8c4add32ecde17b5, e2a1b95cdc4b4537adae26bfb98d48c9; no voters:
I20260811 18:58:40.124336 27004 raft_consensus.cc:2454] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a1b95cdc4b4537adae26bfb98d48c9 in term 0.
I20260811 18:58:40.124389 27387 raft_consensus.cc:2781] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:58:40.124472 27387 raft_consensus.cc:482] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:40.124500 27387 raft_consensus.cc:3037] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:40.125231 27387 raft_consensus.cc:504] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc4a897149f44609113a5c5ab9ae2c0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41091 } } peers { permanent_uuid: "9fe0417d860f4bde8c4add32ecde17b5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39233 } } peers { permanent_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33451 } }
I20260811 18:58:40.125388 27387 leader_election.cc:288] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [CANDIDATE]: Term 1 election: Requested vote from peers 1cc4a897149f44609113a5c5ab9ae2c0 (127.5.226.66:41091), 9fe0417d860f4bde8c4add32ecde17b5 (127.5.226.67:39233)
I20260811 18:58:40.125553 27260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d331b4658c8347a9b00fec05eeaf25df" candidate_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe0417d860f4bde8c4add32ecde17b5"
I20260811 18:58:40.125624 27260 raft_consensus.cc:3037] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:40.126286 27260 raft_consensus.cc:2454] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a1b95cdc4b4537adae26bfb98d48c9 in term 1.
I20260811 18:58:40.126430 26599 leader_election.cc:302] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe0417d860f4bde8c4add32ecde17b5, e2a1b95cdc4b4537adae26bfb98d48c9; no voters:
I20260811 18:58:40.126417 27004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d331b4658c8347a9b00fec05eeaf25df" candidate_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc4a897149f44609113a5c5ab9ae2c0"
I20260811 18:58:40.126490 27004 raft_consensus.cc:3037] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:40.126524 27387 raft_consensus.cc:2781] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:40.126688 27387 raft_consensus.cc:686] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [term 1 LEADER]: Becoming Leader. State: Replica: e2a1b95cdc4b4537adae26bfb98d48c9, State: Running, Role: LEADER
I20260811 18:58:40.126783 27387 consensus_queue.cc:237] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc4a897149f44609113a5c5ab9ae2c0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41091 } } peers { permanent_uuid: "9fe0417d860f4bde8c4add32ecde17b5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39233 } } peers { permanent_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33451 } }
I20260811 18:58:40.127278 27004 raft_consensus.cc:2454] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a1b95cdc4b4537adae26bfb98d48c9 in term 1.
I20260811 18:58:40.127651 26424 catalog_manager.cc:5495] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a1b95cdc4b4537adae26bfb98d48c9 (127.5.226.65). New cstate: current_term: 1 leader_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc4a897149f44609113a5c5ab9ae2c0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe0417d860f4bde8c4add32ecde17b5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a1b95cdc4b4537adae26bfb98d48c9" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33451 } health_report { overall_health: HEALTHY } } }
I20260811 18:58:40.145375 27370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:40.143083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53626 (local address 127.5.226.65:33451)
0811 18:58:40.143133 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:40.143135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:40.143142 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:58:40.143181 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:40.143182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:40.143201 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:40.143270 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:40.143382 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:40.143859 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:40.144552 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:40.144763 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:40.144840 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:40.145022 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:40.145128 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:40.145191 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:40.145257 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 18:58:40.145279 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 18:58:40.147508 27260 raft_consensus.cc:1261] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5 [term 1 FOLLOWER]: Refusing update from remote peer e2a1b95cdc4b4537adae26bfb98d48c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:40.147557 27004 raft_consensus.cc:1261] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0 [term 1 FOLLOWER]: Refusing update from remote peer e2a1b95cdc4b4537adae26bfb98d48c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:40.147876 27397 consensus_queue.cc:1035] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cc4a897149f44609113a5c5ab9ae2c0" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:40.148010 27387 consensus_queue.cc:1035] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe0417d860f4bde8c4add32ecde17b5" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:40.151049 27404 mvcc.cc:205] Tried to move back new op lower bound from 7317400453720883200 to 7317400453639909376. Current Snapshot: MvccSnapshot[applied={T|T < 7317400453720883200 or (T in {7317400453720883200})}]
I20260811 18:58:40.151249 27409 mvcc.cc:205] Tried to move back new op lower bound from 7317400453720883200 to 7317400453639909376. Current Snapshot: MvccSnapshot[applied={T|T < 7317400453720883200}]
I20260811 18:58:40.152845 26426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:40.152966 26426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:40.153769 26426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ea12b6b6cce1429eb23d010b392d1c9d: Sending DeleteTablet for 3 replicas of tablet d331b4658c8347a9b00fec05eeaf25df
I20260811 18:58:40.154079 26965 tablet_service.cc:1514] Processing DeleteTablet for tablet d331b4658c8347a9b00fec05eeaf25df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:40 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:36652
I20260811 18:58:40.154109 27221 tablet_service.cc:1514] Processing DeleteTablet for tablet d331b4658c8347a9b00fec05eeaf25df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:40 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:47872
I20260811 18:58:40.154099 26704 tablet_service.cc:1514] Processing DeleteTablet for tablet d331b4658c8347a9b00fec05eeaf25df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:40 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:53610
I20260811 18:58:40.154340 27431 tablet_replica.cc:330] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9: stopping tablet replica
I20260811 18:58:40.154439 27431 raft_consensus.cc:2229] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:58:40.154537 27431 raft_consensus.cc:2258] T d331b4658c8347a9b00fec05eeaf25df P e2a1b95cdc4b4537adae26bfb98d48c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:40.154613 27430 tablet_replica.cc:330] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0: stopping tablet replica
I20260811 18:58:40.154731 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 26559
I20260811 18:58:40.154793 27430 raft_consensus.cc:2229] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:40.154889 27430 raft_consensus.cc:2258] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:40.155017 27426 tablet_replica.cc:330] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5: stopping tablet replica
I20260811 18:58:40.155090 27426 raft_consensus.cc:2229] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:40.155202 27426 raft_consensus.cc:2258] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:40.158656 27430 ts_tablet_manager.cc:1905] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:40.160668 27430 ts_tablet_manager.cc:1918] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:40.160751 27430 log.cc:1196] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/d331b4658c8347a9b00fec05eeaf25df
I20260811 18:58:40.161029 27430 ts_tablet_manager.cc:1939] T d331b4658c8347a9b00fec05eeaf25df P 1cc4a897149f44609113a5c5ab9ae2c0: Deleting consensus metadata
I20260811 18:58:40.161513 26389 catalog_manager.cc:4841] TS 1cc4a897149f44609113a5c5ab9ae2c0 (127.5.226.66:41091): tablet d331b4658c8347a9b00fec05eeaf25df (table test-table [id=e666454aceb5412eaa086abed164e478]) successfully deleted
I20260811 18:58:40.161984 27426 ts_tablet_manager.cc:1905] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:40.163846 27426 ts_tablet_manager.cc:1918] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:40.163983 27426 log.cc:1196] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/d331b4658c8347a9b00fec05eeaf25df
I20260811 18:58:40.164333 27426 ts_tablet_manager.cc:1939] T d331b4658c8347a9b00fec05eeaf25df P 9fe0417d860f4bde8c4add32ecde17b5: Deleting consensus metadata
I20260811 18:58:40.164779 26388 catalog_manager.cc:4841] TS 9fe0417d860f4bde8c4add32ecde17b5 (127.5.226.67:39233): tablet d331b4658c8347a9b00fec05eeaf25df (table test-table [id=e666454aceb5412eaa086abed164e478]) successfully deleted
W20260811 18:58:40.169498 26390 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:33451 (error 108)
I20260811 18:58:40.169996 27367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:40.169875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:33451 (local address 127.0.0.1:53638)
0811 18:58:40.169923 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:40.169960 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:33451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 18:58:40.170008 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 26828
W20260811 18:58:40.170140 26390 catalog_manager.cc:4584] TS e2a1b95cdc4b4537adae26bfb98d48c9 (127.5.226.65:33451): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d331b4658c8347a9b00fec05eeaf25df: Network error: Client connection negotiation failed: client connection to 127.5.226.65:33451: connect: Connection refused (error 111)
I20260811 18:58:40.185045 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 27104
I20260811 18:58:40.197990 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 26357
2026-08-11T18:58:40Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2299 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:58:40 dist-test-slave-gjw7 krb5kdc[27441](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:58:40 dist-test-slave-gjw7 krb5kdc[27441](info): set up 2 sockets
Aug 11 18:58:40 dist-test-slave-gjw7 krb5kdc[27441](info): commencing operation
krb5kdc: starting...
W20260811 18:58:41.413751 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:58:41 dist-test-slave-gjw7 krb5kdc[27441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:58:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:41Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.5.226.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.5.226.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/rangeradmin_127.5.226.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/rangeradmin_127.5.226.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.5.226.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.5.226.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/rangerlookup_127.5.226.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/rangerlookup_127.5.226.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.5.226.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.226.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/HTTP_127.5.226.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/HTTP_127.5.226.84@KRBTEST.COM.keytab.
I20260811 18:58:41.582243 6025 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskptszHt/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/postgres -l logfile start
2026-08-11 18:58:43.954 UTC [27493] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 18:58:43.955 UTC [27493] LOG: listening on IPv4 address "127.5.226.84", port 46055
2026-08-11 18:58:43.958 UTC [27493] LOG: listening on Unix socket "/tmp/.s.PGSQL.46055"
2026-08-11 18:58:43.978 UTC [27496] LOG: database system was shut down at 2026-08-11 18:58:42 UTC
2026-08-11 18:58:43.982 UTC [27493] LOG: database system is ready to accept connections
I20260811 18:58:45.148427 6025 mini_postgres.cc:96] Postgres bound to 46055
2026-08-11 18:58:45.156 UTC [27511] FATAL: database "slave" does not exist
127.5.226.84:46055 - accepting connections
I20260811 18:58:45.157397 6025 mini_ranger.cc:161] Starting Ranger...
I20260811 18:58:45.173650 6025 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 18:58:45.612051 6025 mini_ranger.cc:87] Created ranger Postgres database
I20260811 18:58:45.612124 6025 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-admin
2026-08-11 18:58:45,968 [I] DB FLAVOR :POSTGRES
2026-08-11 18:58:45,968 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:58:45,968 [I] Checking connection..
2026-08-11 18:58:45,968 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 18:58:46,241 [I] Checking connection passed.
2026-08-11 18:58:46,241 [I] --------- Verifying version history table ---------
2026-08-11 18:58:46,241 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:58:46,488 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:58:46,489 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:58:46,747 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:58:46,748 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 18:58:46,748 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 18:58:47.000 UTC [27633] WARNING: there is no transaction in progress
2026-08-11 18:58:47,009 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 18:58:47,010 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:58:47,278 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 18:58:47,279 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:58:47,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 18:58:47,543 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 18:58:47,807 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gjw7.c.gcp-upstream.internal','N') ;"
2026-08-11 18:58:48,048 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:58:48,297 [I] Table x_portal_user does not exist in database ranger
2026-08-11 18:58:48,297 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:58:48,560 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 18:58:48,561 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:58:48,819 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:58:49,060 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 18:58:49,061 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 18:58:49.992 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.009 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.027 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.044 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.059 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.080 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.135 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.142 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.156 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.166 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.176 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.191 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.201 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.207 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.214 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50.221 UTC [27853] WARNING: there is no transaction in progress
2026-08-11 18:58:50,819 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 18:58:50,820 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 18:58:51,078 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 18:58:51,078 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:58:51,347 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 18:58:51,347 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:58:51,608 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 18:58:51,608 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:58:51,869 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:58:52,132 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gjw7.c.gcp-upstream.internal';"
2026-08-11 18:58:52,375 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 18:58:52,376 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 18:58:52,638 [I] DB_PATCHES have already been applied
I20260811 18:58:52.644423 6025 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-admin:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskptszHt/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 18:58:52.644491 6025 mini_ranger.cc:193] Using host: 127.5.226.84
I20260811 18:58:52.648300 6025 mini_ranger.cc:227] Ranger admin URL: http://127.5.226.84:59635
Aug 11, 2026 6:58:52 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:58:52 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:58:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 6:58:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 6:58:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 6:58:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 6:58:53 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 18:58:53.976447 6025 mini_ranger.cc:160] Time spent starting Ranger: real 8.819s user 0.000s sys 0.011s
Aug 11, 2026 6:59:14 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 6:59:14 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 6:59:14 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 6:59:14 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 6:59:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 6:59:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 6:59:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 6:59:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 6:59:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 6:59:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 6:59:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 6:59:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 6:59:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 6:59:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 6:59:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 6:59:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 6:59:14 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 6:59:15 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 18:59:16.087913 6025 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.5.226.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.5.226.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/rangerkms_127.5.226.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/rangerkms_127.5.226.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.5.226.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.5.226.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.226.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/HTTP_127.5.226.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.5.226.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/HTTP_127.5.226.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 18:59:16 dist-test-slave-gjw7 krb5kdc[27441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474756, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 18:59:16.178933 6025 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 18:59:16.188987 6025 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 18:59:16.949728 6025 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 18:59:16.949819 6025 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-kms
I20260811 18:59:16.949836 6025 mini_ranger_kms.cc:227] Using postgres at 127.5.226.84:46055
2026-08-11 18:59:17,240 [I] DB FLAVOR :POSTGRES
2026-08-11 18:59:17,240 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:59:17,241 [I] Checking connection
2026-08-11 18:59:17,241 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 18:59:17,495 [I] connection success
2026-08-11 18:59:17,495 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 18:59:17,495 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 18:59:17,495 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 18:59:17,737 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 18:59:17,737 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:59:17,737 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 18:59:17,737 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:46055/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 18:59:17,994 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 18:59:18.468941 6025 mini_ranger_kms.cc:310] Created kms service
I20260811 18:59:18.662763 6025 mini_ranger_kms.cc:326] Created kudu user
I20260811 18:59:18.706444 6025 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 18:59:18 dist-test-slave-gjw7 krb5kdc[27441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474756, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 18:59:19.111449 6025 mini_ranger_kms.cc:384] Added ranger policy
I20260811 18:59:19.111726 6025 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-kms:/tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 18:59:19.111757 6025 mini_ranger_kms.cc:240] Using host: 127.5.226.84
I20260811 18:59:19.116454 6025 mini_ranger_kms.cc:276] Ranger KMS PID: 28214
I20260811 18:59:19.116544 6025 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.5.226.84:49135
Aug 11, 2026 6:59:20 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:59:20 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:59:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 6:59:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 6:59:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 6:59:20 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 18:59:21 dist-test-slave-gjw7 krb5kdc[27441](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474761, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.226.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:21.776072 6025 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.597s user 0.000s sys 0.269s
I20260811 18:59:21.776181 6025 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 18:59:21.776253 6025 mini_ranger_kms.cc:401] 127.5.226.84:49135/kms/v1/keys
Aug 11 18:59:21 dist-test-slave-gjw7 krb5kdc[27441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474761, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.226.84@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
Aug 11 18:59:22 dist-test-slave-gjw7 krb5kdc[27441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474761, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.226.84@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
Aug 11 18:59:24 dist-test-slave-gjw7 krb5kdc[27441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474764, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 18:59:24.499502 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:33845
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:44497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:33845
--ranger_config_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.226.84:49135/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:24.582347 28305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:24.582546 28305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:24.582566 28305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:24.583688 28305 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:24.583729 28305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:24.583740 28305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:24.583752 28305 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:24.583765 28305 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:24.585474 28305 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:44497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/wal
--ranger_kms_url=127.5.226.84:49135/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:33845
--ranger_config_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:33845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:59:24.585698 28305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:24.585913 28305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:24.590590 28315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:24.590600 28325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:24.590894 28319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:24.590919 28305 server_base.cc:1034] running on GCE node
I20260811 18:59:24.591234 28305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:24.591576 28305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:24.592749 28305 hybrid_clock.cc:648] HybridClock initialized: now 1786474764592727 us; error 37 us; skew 500 ppm
Aug 11 18:59:24 dist-test-slave-gjw7 krb5kdc[27441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474764, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:24.595717 28305 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 18:59:24.596246 28305 webserver.cc:460] Webserver started at http://127.5.226.126:34169/ using document root <none> and password file <none>
I20260811 18:59:24.596501 28305 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:24.596561 28305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:24.596689 28305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:59:24 dist-test-slave-gjw7 krb5kdc[27441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474764, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 18:59:24.644519 28305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "a63486ddf37342e79c8c5d1a73820dd8"
format_stamp: "Formatted at 2026-08-11 18:59:24 on dist-test-slave-gjw7"
server_key: "503b3b5ee1e10bef7e252d9d7e6c06c1"
server_key_iv: "c64040cc8f5b4da608366740cf94d321"
server_key_version: "kuduclusterkey@0"
I20260811 18:59:24.645007 28305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "a63486ddf37342e79c8c5d1a73820dd8"
format_stamp: "Formatted at 2026-08-11 18:59:24 on dist-test-slave-gjw7"
server_key: "503b3b5ee1e10bef7e252d9d7e6c06c1"
server_key_iv: "c64040cc8f5b4da608366740cf94d321"
server_key_version: "kuduclusterkey@0"
I20260811 18:59:24.646862 28305 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 18:59:24.661424 28344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:24.661608 28305 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:59:24.661715 28305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "a63486ddf37342e79c8c5d1a73820dd8"
format_stamp: "Formatted at 2026-08-11 18:59:24 on dist-test-slave-gjw7"
server_key: "503b3b5ee1e10bef7e252d9d7e6c06c1"
server_key_iv: "c64040cc8f5b4da608366740cf94d321"
server_key_version: "kuduclusterkey@0"
I20260811 18:59:24.661826 28305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:24.683799 28305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:24.686059 28305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:24.686220 28305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:24.691483 28305 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:33845
I20260811 18:59:24.691511 28454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:33845 every 8 connection(s)
I20260811 18:59:24.691956 28305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:24.692691 28458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:24.695089 28458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8: Bootstrap starting.
I20260811 18:59:24.695645 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 28305
I20260811 18:59:24.695668 28458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:24.695745 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 18:59:24.695956 6025 external_mini_cluster.cc:1428] Setting key 7a111174cbcb21c5540f07b754462ceb
I20260811 18:59:24.695971 28458 log.cc:824] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:24.696720 28458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8: No bootstrap required, opened a new log
I20260811 18:59:24.699631 28458 raft_consensus.cc:348] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a63486ddf37342e79c8c5d1a73820dd8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33845 } }
I20260811 18:59:24.699819 28458 raft_consensus.cc:374] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:24.699856 28458 raft_consensus.cc:729] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63486ddf37342e79c8c5d1a73820dd8, State: Initialized, Role: FOLLOWER
I20260811 18:59:24.700018 28458 consensus_queue.cc:260] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a63486ddf37342e79c8c5d1a73820dd8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33845 } }
I20260811 18:59:24.700201 28458 raft_consensus.cc:388] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:24.700268 28458 raft_consensus.cc:482] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:24.700313 28458 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:24.701030 28458 raft_consensus.cc:504] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a63486ddf37342e79c8c5d1a73820dd8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33845 } }
I20260811 18:59:24.701141 28458 leader_election.cc:302] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a63486ddf37342e79c8c5d1a73820dd8; no voters:
I20260811 18:59:24.701383 28458 leader_election.cc:288] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:24.701433 28471 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [term 1 FOLLOWER]: Leader election won for term 1
Aug 11 18:59:24 dist-test-slave-gjw7 krb5kdc[27441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474764, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:59:24.702301 28471 raft_consensus.cc:686] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [term 1 LEADER]: Becoming Leader. State: Replica: a63486ddf37342e79c8c5d1a73820dd8, State: Running, Role: LEADER
I20260811 18:59:24.702440 28471 consensus_queue.cc:237] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a63486ddf37342e79c8c5d1a73820dd8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33845 } }
I20260811 18:59:24.701767 28458 sys_catalog.cc:564] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:24.704836 28477 sys_catalog.cc:455] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a63486ddf37342e79c8c5d1a73820dd8. Latest consensus state: current_term: 1 leader_uuid: "a63486ddf37342e79c8c5d1a73820dd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a63486ddf37342e79c8c5d1a73820dd8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33845 } } }
I20260811 18:59:24.704933 28477 sys_catalog.cc:458] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:24.705107 28476 sys_catalog.cc:455] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a63486ddf37342e79c8c5d1a73820dd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a63486ddf37342e79c8c5d1a73820dd8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33845 } } }
I20260811 18:59:24.705170 28476 sys_catalog.cc:458] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:24.705191 28458 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 18:59:24.708439 28468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:24.696480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53492 (local address 127.5.226.126:33845)
0811 18:59:24.696646 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:24.696655 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:24.696684 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:59:24.697132 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:24.697140 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:24.697197 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:24.697357 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:24.697948 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:24.698821 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:24.699533 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:24.700011 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:24.700115 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:24.702629 (+ 2514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:24.702633 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:24.702634 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:24.702646 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:24.704431 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:24.705228 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:24.705231 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:24.705231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:24.705352 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:24.705580 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:24.705581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:24.705582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:24.707294 (+ 1712us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:24.707644 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:24.707765 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 18:59:24.708125 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":63,"threads_started":1}
I20260811 18:59:24.709035 28504 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:24.709774 28504 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:24.713795 28504 catalog_manager.cc:1347] Generated new cluster ID: 6f0772987b5949258d9c83ef6748d905
I20260811 18:59:24.713846 28504 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:24.723531 28504 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:24.724294 28504 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:24.727248 28504 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8: Generated new TSK 0
I20260811 18:59:24.727602 28504 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 18:59:25.470510 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.226.84:49135/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33845
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:44497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:25.578622 28557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:25.578822 28557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:25.578845 28557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:25.580201 28557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:25.580260 28557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:25.580309 28557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 18:59:25.582583 28557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:44497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.5.226.84:49135/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:59:25.582858 28557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:25.583179 28557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:25.589576 28564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:25.589576 28572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:25.589759 28568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:25.590514 28557 server_base.cc:1034] running on GCE node
I20260811 18:59:25.590710 28557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:25.590967 28557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:25.592124 28557 hybrid_clock.cc:648] HybridClock initialized: now 1786474765592102 us; error 40 us; skew 500 ppm
Aug 11 18:59:25 dist-test-slave-gjw7 krb5kdc[27441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474765, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:25.595294 28557 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 18:59:25.595817 28557 webserver.cc:460] Webserver started at http://127.5.226.65:46255/ using document root <none> and password file <none>
I20260811 18:59:25.596100 28557 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:25.596154 28557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:25.596288 28557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:59:25 dist-test-slave-gjw7 krb5kdc[27441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474765, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 18:59:25.614558 28557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286"
format_stamp: "Formatted at 2026-08-11 18:59:25 on dist-test-slave-gjw7"
server_key: "280581eee69df5ade67e96370338e98e"
server_key_iv: "d8f4357d2a9b81d7d6fb0c5a33b1ef0f"
server_key_version: "kuduclusterkey@0"
I20260811 18:59:25.615123 28557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286"
format_stamp: "Formatted at 2026-08-11 18:59:25 on dist-test-slave-gjw7"
server_key: "280581eee69df5ade67e96370338e98e"
server_key_iv: "d8f4357d2a9b81d7d6fb0c5a33b1ef0f"
server_key_version: "kuduclusterkey@0"
I20260811 18:59:25.620229 28557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.000s
I20260811 18:59:25.634510 28590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:25.634728 28557 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:59:25.634838 28557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286"
format_stamp: "Formatted at 2026-08-11 18:59:25 on dist-test-slave-gjw7"
server_key: "280581eee69df5ade67e96370338e98e"
server_key_iv: "d8f4357d2a9b81d7d6fb0c5a33b1ef0f"
server_key_version: "kuduclusterkey@0"
I20260811 18:59:25.634949 28557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:25.652705 28557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:25.654933 28557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:25.655228 28557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:25.655474 28557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:59:25.655889 28557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:59:25.655941 28557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:25.655970 28557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:59:25.656009 28557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:25.662844 28557 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:41525
I20260811 18:59:25.663228 28557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 18:59:25.663827 28814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:41525 every 8 connection(s)
I20260811 18:59:25.664333 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 28557
I20260811 18:59:25.664424 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 18:59:25.664626 6025 external_mini_cluster.cc:1428] Setting key 022fabc4ccb7df87cc54bc1d2912c3a4
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Aug 11 18:59:25 dist-test-slave-gjw7 krb5kdc[27441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474765, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:59:25.696247 28823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:25.665889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:39169 (local address 127.5.226.126:33845)
0811 18:59:25.686321 (+ 20432us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:25.686323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:25.686330 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:59:25.686354 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:25.686355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:25.686365 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:25.686425 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:25.687440 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:25.688256 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:25.689723 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:25.690034 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:25.690076 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:25.692792 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:25.692794 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:25.692795 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:25.692803 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:25.694615 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:25.695098 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:25.695100 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:25.695100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:25.695165 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:25.695444 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:25.695445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:25.695446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:25.695584 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:25.695635 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:25.696049 (+ 414us) server_negotiation.cc:299] Negotiation successful
0811 18:59:25.696142 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20397,"thread_start_us":75,"threads_started":1}
I20260811 18:59:25.697031 28822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:25.665584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33845 (local address 127.5.226.65:39169)
0811 18:59:25.685565 (+ 19981us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:25.685625 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:25.686150 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:25.686562 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:25.686609 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:25.686933 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:25.687306 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:25.687315 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:25.688396 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:25.688397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:25.689620 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:25.689623 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:25.690171 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:25.690172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:25.690333 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:25.690951 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:25.690962 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:25.692675 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:25.694714 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:25.694721 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:25.694724 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:25.695007 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:25.695233 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:25.695234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:25.695234 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:25.695375 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:25.695684 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:25.695691 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:25.695862 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 18:59:25.696626 (+ 764us) client_negotiation.cc:240] Negotiation successful
0811 18:59:25.696803 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19919,"thread_start_us":96,"threads_started":1}
I20260811 18:59:25.697813 28816 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33845
I20260811 18:59:25.697916 28816 heartbeater.cc:464] Registering TS with master...
I20260811 18:59:25.698096 28816 heartbeater.cc:511] Master 127.5.226.126:33845 requested a full tablet report, sending...
I20260811 18:59:25.698653 28384 ts_manager.cc:194] Registered new tserver with Master: 78d0ac2c89c34ccb9a3fac7d1b5da286 (127.5.226.65:41525)
I20260811 18:59:25.699532 28384 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:39169
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 18:59:25.717865 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.226.84:49135/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33845
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:44497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:59:25 dist-test-slave-gjw7 krb5kdc[27441](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474765, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 18:59:25.835585 28836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:25.835808 28836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:25.835841 28836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:25.837042 28836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:25.837092 28836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:25.837129 28836 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 18:59:25.838783 28836 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:44497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.5.226.84:49135/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:59:25.839016 28836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:25.839237 28836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:25.845086 28853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:25.845242 28836 server_base.cc:1034] running on GCE node
W20260811 18:59:25.845094 28843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:25.845431 28848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:25.845643 28836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:25.845913 28836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:25.847069 28836 hybrid_clock.cc:648] HybridClock initialized: now 1786474765847053 us; error 33 us; skew 500 ppm
Aug 11 18:59:25 dist-test-slave-gjw7 krb5kdc[27441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474765, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:25.849998 28836 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 18:59:25.850610 28836 webserver.cc:460] Webserver started at http://127.5.226.66:33107/ using document root <none> and password file <none>
I20260811 18:59:25.850862 28836 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:25.850966 28836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:25.851130 28836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:59:25 dist-test-slave-gjw7 krb5kdc[27441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474765, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 18:59:25.872680 28836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "7ac24a4566dc409d9a82d25286b14b73"
format_stamp: "Formatted at 2026-08-11 18:59:25 on dist-test-slave-gjw7"
server_key: "2db2bdf08b26b6541c4034d3f696df81"
server_key_iv: "e7bf3246d5e4096eed209093d4c712e1"
server_key_version: "kuduclusterkey@0"
I20260811 18:59:25.873138 28836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "7ac24a4566dc409d9a82d25286b14b73"
format_stamp: "Formatted at 2026-08-11 18:59:25 on dist-test-slave-gjw7"
server_key: "2db2bdf08b26b6541c4034d3f696df81"
server_key_iv: "e7bf3246d5e4096eed209093d4c712e1"
server_key_version: "kuduclusterkey@0"
I20260811 18:59:25.875068 28836 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260811 18:59:25.896908 28869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:25.897168 28836 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260811 18:59:25.897315 28836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "7ac24a4566dc409d9a82d25286b14b73"
format_stamp: "Formatted at 2026-08-11 18:59:25 on dist-test-slave-gjw7"
server_key: "2db2bdf08b26b6541c4034d3f696df81"
server_key_iv: "e7bf3246d5e4096eed209093d4c712e1"
server_key_version: "kuduclusterkey@0"
I20260811 18:59:25.897430 28836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:25.914040 28836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:25.916004 28836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:25.916143 28836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:25.916348 28836 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:59:25.916728 28836 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:59:25.916766 28836 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:25.916795 28836 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:59:25.916836 28836 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:25.924310 28836 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:41795
I20260811 18:59:25.924817 28836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 18:59:25.926301 29109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:41795 every 8 connection(s)
I20260811 18:59:25.927299 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 28836
I20260811 18:59:25.927398 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 18:59:25.927577 6025 external_mini_cluster.cc:1428] Setting key 079897daa10c9c7e366a1ef9dcbcf5ab
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Aug 11 18:59:25 dist-test-slave-gjw7 krb5kdc[27441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474765, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:59:25.958897 28823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:25.932453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:53789 (local address 127.5.226.126:33845)
0811 18:59:25.932692 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:25.932694 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:25.932705 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:59:25.933358 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:25.933359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:25.933376 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:25.933405 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:25.934145 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:25.934842 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:25.936454 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:25.936871 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:25.936919 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:25.953105 (+ 16186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:25.953107 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:25.953107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:25.953118 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:25.955589 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:25.957519 (+ 1930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:25.957521 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:25.957521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:25.957586 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:25.957920 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:25.957922 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:25.957922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:25.958127 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:25.958195 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:25.958691 (+ 496us) server_negotiation.cc:299] Negotiation successful
0811 18:59:25.958794 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197}
I20260811 18:59:25.959759 29116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:25.932083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33845 (local address 127.5.226.66:53789)
0811 18:59:25.932536 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:25.932583 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:25.933205 (+ 622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:25.933622 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:25.933627 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:25.933833 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:25.934040 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:25.934045 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:25.934953 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:25.934954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:25.936351 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:25.936355 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:25.948475 (+ 12120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:25.948476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:25.948692 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:25.949407 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:25.949423 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:25.952932 (+ 3509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:25.957122 (+ 4190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:25.957129 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:25.957131 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:25.957438 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:25.957668 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:25.957669 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:25.957669 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:25.957834 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:25.958233 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:25.958242 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:25.958428 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 18:59:25.959321 (+ 893us) client_negotiation.cc:240] Negotiation successful
0811 18:59:25.959511 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":155,"threads_started":1}
I20260811 18:59:25.960496 29110 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33845
I20260811 18:59:25.960606 29110 heartbeater.cc:464] Registering TS with master...
I20260811 18:59:25.960798 29110 heartbeater.cc:511] Master 127.5.226.126:33845 requested a full tablet report, sending...
I20260811 18:59:25.961189 28384 ts_manager.cc:194] Registered new tserver with Master: 7ac24a4566dc409d9a82d25286b14b73 (127.5.226.66:41795)
I20260811 18:59:25.961804 28384 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:53789
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 18:59:25.965365 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.226.84:49135/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33845
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:44497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:26.101562 29118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:26.101857 29118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:26.101902 29118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:26.103221 29118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:26.103262 29118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:26.103307 29118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 18:59:26.104902 29118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:44497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.5.226.84:49135/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:59:26.105131 29118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:26.105405 29118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:26.110348 29127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:26.110494 29136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:26.110579 29139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:26.110764 29118 server_base.cc:1034] running on GCE node
I20260811 18:59:26.110973 29118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:26.111200 29118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:26.112372 29118 hybrid_clock.cc:648] HybridClock initialized: now 1786474766112350 us; error 35 us; skew 500 ppm
Aug 11 18:59:26 dist-test-slave-gjw7 krb5kdc[27441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474766, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:26.114923 29118 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 18:59:26.115365 29118 webserver.cc:460] Webserver started at http://127.5.226.67:36071/ using document root <none> and password file <none>
I20260811 18:59:26.115567 29118 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:26.115617 29118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:26.115744 29118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:59:26 dist-test-slave-gjw7 krb5kdc[27441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474766, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 18:59:26.143177 29118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "360284dd6e9046c79376c0f82f739b99"
format_stamp: "Formatted at 2026-08-11 18:59:26 on dist-test-slave-gjw7"
server_key: "9c6d234e055b9365c427aef183a35309"
server_key_iv: "dc37fc2d849541c9a2cb63884f319b7a"
server_key_version: "kuduclusterkey@0"
I20260811 18:59:26.143723 29118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "360284dd6e9046c79376c0f82f739b99"
format_stamp: "Formatted at 2026-08-11 18:59:26 on dist-test-slave-gjw7"
server_key: "9c6d234e055b9365c427aef183a35309"
server_key_iv: "dc37fc2d849541c9a2cb63884f319b7a"
server_key_version: "kuduclusterkey@0"
I20260811 18:59:26.148145 29118 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260811 18:59:26.162940 29155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:26.163199 29118 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:59:26.163293 29118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "360284dd6e9046c79376c0f82f739b99"
format_stamp: "Formatted at 2026-08-11 18:59:26 on dist-test-slave-gjw7"
server_key: "9c6d234e055b9365c427aef183a35309"
server_key_iv: "dc37fc2d849541c9a2cb63884f319b7a"
server_key_version: "kuduclusterkey@0"
I20260811 18:59:26.163381 29118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:26.207042 29118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:26.209442 29118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:26.209656 29118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:26.209929 29118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:59:26.210342 29118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:59:26.210428 29118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:26.210494 29118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:59:26.210547 29118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:26.217397 29118 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:34725
I20260811 18:59:26.218048 29118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 18:59:26.220661 29400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:34725 every 8 connection(s)
I20260811 18:59:26.225677 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 29118
I20260811 18:59:26.225765 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 18:59:26.225944 6025 external_mini_cluster.cc:1428] Setting key b64709642f71b94fee0d84dba9897923
Aug 11 18:59:26 dist-test-slave-gjw7 krb5kdc[27441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474766, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 18:59:26.232470 28823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.221270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:57317 (local address 127.5.226.126:33845)
0811 18:59:26.221338 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:26.221340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:26.221570 (+ 230us) server_negotiation.cc:407] Connection header received
0811 18:59:26.222262 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:26.222264 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:26.222277 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:26.222304 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:26.223277 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.224055 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.226299 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.226599 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.226643 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:26.229267 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:26.229269 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:26.229270 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:26.229278 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:26.230892 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:26.231415 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:26.231416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:26.231416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:26.231479 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:26.231738 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:26.231739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:26.231739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:26.231869 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:26.231907 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:26.232280 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 18:59:26.232372 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 18:59:26.233381 29406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.221267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33845 (local address 127.5.226.67:57317)
0811 18:59:26.221443 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:26.221485 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:26.222123 (+ 638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:26.222494 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:26.222498 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:26.222873 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:26.223155 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:26.223162 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.224169 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.224170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:26.226202 (+ 2032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:26.226205 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.226818 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.226819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:26.226963 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:26.227516 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:26.227527 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:26.229142 (+ 1615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:26.230988 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:26.230996 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:26.230999 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:26.231325 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:26.231542 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:26.231542 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:26.231543 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:26.231672 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:26.231948 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:26.231953 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:26.232115 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 18:59:26.232925 (+ 810us) client_negotiation.cc:240] Negotiation successful
0811 18:59:26.233109 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":108,"threads_started":1}
I20260811 18:59:26.235140 29404 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33845
I20260811 18:59:26.235256 29404 heartbeater.cc:464] Registering TS with master...
I20260811 18:59:26.235455 29404 heartbeater.cc:511] Master 127.5.226.126:33845 requested a full tablet report, sending...
I20260811 18:59:26.235922 28384 ts_manager.cc:194] Registered new tserver with Master: 360284dd6e9046c79376c0f82f739b99 (127.5.226.67:34725)
I20260811 18:59:26.236406 28384 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:57317
I20260811 18:59:26.238457 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:59:26.254073 28823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.240625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53496 (local address 127.5.226.126:33845)
0811 18:59:26.240666 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:26.240668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:26.240941 (+ 273us) server_negotiation.cc:407] Connection header received
0811 18:59:26.241029 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:26.241030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:26.241040 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:26.241066 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:26.244407 (+ 3341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.245133 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.246274 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.246511 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.246549 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:26.251258 (+ 4709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:26.251260 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:26.251260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:26.251268 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:26.252834 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:26.253218 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:26.253219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:26.253219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:26.253276 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:26.253482 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:26.253483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:26.253483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:26.253603 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:26.253686 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:26.253891 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 18:59:26.253978 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:59:26.256333 28384 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53496:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:59:26.258853 28384 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:59:26.274814 29430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.263036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:34725 (local address 127.0.0.1:59936)
0811 18:59:26.264558 (+ 1522us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:26.264567 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:26.264606 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:26.265230 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:26.265231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:26.265232 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:26.265256 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:26.265257 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.267245 (+ 1988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.267246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:26.269433 (+ 2187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:26.269437 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.274510 (+ 5073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.274511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:26.274598 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:26.274614 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 18:59:26.274676 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 18:59:26.274726 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1508,"thread_start_us":98,"threads_started":1}
I20260811 18:59:26.275288 29435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.263683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59936 (local address 127.5.226.67:34725)
0811 18:59:26.264513 (+ 830us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:26.264518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:26.264650 (+ 132us) server_negotiation.cc:407] Connection header received
0811 18:59:26.264690 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:26.264692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:26.264708 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:26.264770 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:26.265338 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.267161 (+ 1823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.269545 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.270264 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.270331 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:26.270408 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:26.275156 (+ 4748us) server_negotiation.cc:299] Negotiation successful
0811 18:59:26.275204 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":792,"thread_start_us":222,"threads_started":1}
I20260811 18:59:26.277215 29267 tablet_service.cc:1467] Processing CreateTablet for tablet ca1446f3f19148058263e52c52a20fcc (DEFAULT_TABLE table=test-table [id=c99a1e17d75f4bfa832877f4b289bec6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:59:26.277661 29267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca1446f3f19148058263e52c52a20fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:26.281261 29429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.263231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:41795 (local address 127.0.0.1:37408)
0811 18:59:26.269382 (+ 6151us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:26.269395 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:26.269459 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:26.277354 (+ 7895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:26.277355 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:26.277358 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:26.277403 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:26.277405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.278753 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.278755 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:26.279877 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:26.279881 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.280996 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.280997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:26.281066 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:26.281071 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:59:26.281126 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 18:59:26.281183 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6130,"thread_start_us":248,"threads_started":1}
I20260811 18:59:26.281615 29434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.263514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37408 (local address 127.5.226.66:41795)
0811 18:59:26.271246 (+ 7732us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:26.271251 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:26.271261 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:59:26.271301 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:26.271303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:26.271318 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:26.271391 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:26.277527 (+ 6136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.278635 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.280016 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.280786 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.280868 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:26.280953 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:26.281479 (+ 526us) server_negotiation.cc:299] Negotiation successful
0811 18:59:26.281526 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7689,"thread_start_us":101,"threads_started":1}
I20260811 18:59:26.276441 29433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.262968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:41525 (local address 127.0.0.1:40784)
0811 18:59:26.264263 (+ 1295us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:26.264307 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:26.264368 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:26.265097 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:26.265101 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:26.265103 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:26.265170 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:26.265172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.271677 (+ 6505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.271678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:26.273889 (+ 2211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:26.273892 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.276223 (+ 2331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.276224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:26.276288 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:26.276291 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:59:26.276332 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 18:59:26.276371 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1260,"thread_start_us":84,"threads_started":1}
I20260811 18:59:26.282562 29431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.263365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40784 (local address 127.5.226.65:41525)
0811 18:59:26.264902 (+ 1537us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:26.264906 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:26.264915 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:59:26.264945 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:26.264947 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:26.264961 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:26.265026 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:26.267557 (+ 2531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.271598 (+ 4041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.273983 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.276063 (+ 2080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.276130 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:26.276188 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:26.282433 (+ 6245us) server_negotiation.cc:299] Negotiation successful
0811 18:59:26.282492 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1503,"thread_start_us":61,"threads_started":1}
I20260811 18:59:26.282495 28930 tablet_service.cc:1467] Processing CreateTablet for tablet ca1446f3f19148058263e52c52a20fcc (DEFAULT_TABLE table=test-table [id=c99a1e17d75f4bfa832877f4b289bec6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:59:26.282907 28930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca1446f3f19148058263e52c52a20fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:26.283061 29437 tablet_bootstrap.cc:492] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99: Bootstrap starting.
I20260811 18:59:26.283286 28693 tablet_service.cc:1467] Processing CreateTablet for tablet ca1446f3f19148058263e52c52a20fcc (DEFAULT_TABLE table=test-table [id=c99a1e17d75f4bfa832877f4b289bec6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:59:26.283607 28693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca1446f3f19148058263e52c52a20fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:26.284127 29437 tablet_bootstrap.cc:654] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:26.284474 29437 log.cc:824] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:26.285529 29437 tablet_bootstrap.cc:492] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99: No bootstrap required, opened a new log
I20260811 18:59:26.285594 29437 ts_tablet_manager.cc:1397] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:59:26.287570 29437 raft_consensus.cc:348] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 41525 } } peers { permanent_uuid: "360284dd6e9046c79376c0f82f739b99" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 34725 } } peers { permanent_uuid: "7ac24a4566dc409d9a82d25286b14b73" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41795 } }
I20260811 18:59:26.287755 29437 raft_consensus.cc:374] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:26.287787 29437 raft_consensus.cc:729] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360284dd6e9046c79376c0f82f739b99, State: Initialized, Role: FOLLOWER
I20260811 18:59:26.287889 29437 consensus_queue.cc:260] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 41525 } } peers { permanent_uuid: "360284dd6e9046c79376c0f82f739b99" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 34725 } } peers { permanent_uuid: "7ac24a4566dc409d9a82d25286b14b73" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41795 } }
I20260811 18:59:26.288121 29437 ts_tablet_manager.cc:1428] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:59:26.289855 29404 heartbeater.cc:503] Master 127.5.226.126:33845 was elected leader, sending a full tablet report...
I20260811 18:59:26.293443 29443 tablet_bootstrap.cc:492] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73: Bootstrap starting.
I20260811 18:59:26.294553 29443 tablet_bootstrap.cc:654] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:26.294767 29447 tablet_bootstrap.cc:492] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286: Bootstrap starting.
I20260811 18:59:26.295329 29447 tablet_bootstrap.cc:654] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:26.295593 29447 log.cc:824] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:26.296133 29443 log.cc:824] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:26.296697 29447 tablet_bootstrap.cc:492] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286: No bootstrap required, opened a new log
I20260811 18:59:26.296761 29447 ts_tablet_manager.cc:1397] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:59:26.299286 29447 raft_consensus.cc:348] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 41525 } } peers { permanent_uuid: "360284dd6e9046c79376c0f82f739b99" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 34725 } } peers { permanent_uuid: "7ac24a4566dc409d9a82d25286b14b73" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41795 } }
I20260811 18:59:26.299523 29447 raft_consensus.cc:374] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:26.299603 29447 raft_consensus.cc:729] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78d0ac2c89c34ccb9a3fac7d1b5da286, State: Initialized, Role: FOLLOWER
I20260811 18:59:26.299808 29447 consensus_queue.cc:260] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 41525 } } peers { permanent_uuid: "360284dd6e9046c79376c0f82f739b99" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 34725 } } peers { permanent_uuid: "7ac24a4566dc409d9a82d25286b14b73" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41795 } }
I20260811 18:59:26.300139 29447 ts_tablet_manager.cc:1428] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:59:26.300414 28816 heartbeater.cc:503] Master 127.5.226.126:33845 was elected leader, sending a full tablet report...
I20260811 18:59:26.304050 29443 tablet_bootstrap.cc:492] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73: No bootstrap required, opened a new log
I20260811 18:59:26.304172 29443 ts_tablet_manager.cc:1397] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260811 18:59:26.306136 29443 raft_consensus.cc:348] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 41525 } } peers { permanent_uuid: "360284dd6e9046c79376c0f82f739b99" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 34725 } } peers { permanent_uuid: "7ac24a4566dc409d9a82d25286b14b73" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41795 } }
I20260811 18:59:26.312333 29443 raft_consensus.cc:374] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:26.312445 29443 raft_consensus.cc:729] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac24a4566dc409d9a82d25286b14b73, State: Initialized, Role: FOLLOWER
I20260811 18:59:26.312628 29443 consensus_queue.cc:260] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 41525 } } peers { permanent_uuid: "360284dd6e9046c79376c0f82f739b99" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 34725 } } peers { permanent_uuid: "7ac24a4566dc409d9a82d25286b14b73" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41795 } }
I20260811 18:59:26.312991 29443 ts_tablet_manager.cc:1428] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260811 18:59:26.313174 29110 heartbeater.cc:503] Master 127.5.226.126:33845 was elected leader, sending a full tablet report...
Aug 11 18:59:26 dist-test-slave-gjw7 krb5kdc[27441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474765, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 18:59:26.400342 29456 raft_consensus.cc:482] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:59:26.400498 29456 raft_consensus.cc:504] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 41525 } } peers { permanent_uuid: "360284dd6e9046c79376c0f82f739b99" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 34725 } } peers { permanent_uuid: "7ac24a4566dc409d9a82d25286b14b73" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41795 } }
I20260811 18:59:26.400897 29456 leader_election.cc:288] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 360284dd6e9046c79376c0f82f739b99 (127.5.226.67:34725), 7ac24a4566dc409d9a82d25286b14b73 (127.5.226.66:41795)
I20260811 18:59:26.409197 29435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.401423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:44579 (local address 127.5.226.67:34725)
0811 18:59:26.401482 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:26.401484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:26.405502 (+ 4018us) server_negotiation.cc:407] Connection header received
0811 18:59:26.405636 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:26.405637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:26.405650 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:26.405684 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:26.405968 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.406713 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.408227 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.408768 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.408824 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:26.408836 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:26.409068 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 18:59:26.409109 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 18:59:26.409693 29460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.401582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:34725 (local address 127.5.226.65:44579)
0811 18:59:26.405418 (+ 3836us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:26.405432 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:26.405541 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:26.405768 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:26.405770 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:26.405772 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:26.405869 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:26.405872 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.406857 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.406858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:26.408087 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:26.408092 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.408909 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.408910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:26.408982 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:26.408987 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:59:26.409546 (+ 559us) client_negotiation.cc:240] Negotiation successful
0811 18:59:26.409599 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3810,"thread_start_us":116,"threads_started":1}
I20260811 18:59:26.410287 29268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca1446f3f19148058263e52c52a20fcc" candidate_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360284dd6e9046c79376c0f82f739b99" is_pre_election: true
I20260811 18:59:26.410459 29268 raft_consensus.cc:2454] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78d0ac2c89c34ccb9a3fac7d1b5da286 in term 0.
I20260811 18:59:26.410729 28596 leader_election.cc:302] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360284dd6e9046c79376c0f82f739b99, 78d0ac2c89c34ccb9a3fac7d1b5da286; no voters:
I20260811 18:59:26.410877 29456 raft_consensus.cc:2781] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:59:26.410951 29456 raft_consensus.cc:482] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:59:26.410974 29456 raft_consensus.cc:3037] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:26.411886 29456 raft_consensus.cc:504] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 41525 } } peers { permanent_uuid: "360284dd6e9046c79376c0f82f739b99" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 34725 } } peers { permanent_uuid: "7ac24a4566dc409d9a82d25286b14b73" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41795 } }
I20260811 18:59:26.412014 29456 leader_election.cc:288] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [CANDIDATE]: Term 1 election: Requested vote from peers 360284dd6e9046c79376c0f82f739b99 (127.5.226.67:34725), 7ac24a4566dc409d9a82d25286b14b73 (127.5.226.66:41795)
I20260811 18:59:26.412642 29268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca1446f3f19148058263e52c52a20fcc" candidate_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360284dd6e9046c79376c0f82f739b99"
I20260811 18:59:26.412724 29268 raft_consensus.cc:3037] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:26.413596 29268 raft_consensus.cc:2454] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78d0ac2c89c34ccb9a3fac7d1b5da286 in term 1.
I20260811 18:59:26.413822 28596 leader_election.cc:302] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360284dd6e9046c79376c0f82f739b99, 78d0ac2c89c34ccb9a3fac7d1b5da286; no voters:
I20260811 18:59:26.413939 29456 raft_consensus.cc:2781] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:26.414078 29456 raft_consensus.cc:686] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [term 1 LEADER]: Becoming Leader. State: Replica: 78d0ac2c89c34ccb9a3fac7d1b5da286, State: Running, Role: LEADER
I20260811 18:59:26.414162 29456 consensus_queue.cc:237] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 41525 } } peers { permanent_uuid: "360284dd6e9046c79376c0f82f739b99" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 34725 } } peers { permanent_uuid: "7ac24a4566dc409d9a82d25286b14b73" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41795 } }
W20260811 18:59:26.414191 28821 tablet.cc:2369] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:59:26.414820 29434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.402023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:52555 (local address 127.5.226.66:41795)
0811 18:59:26.402072 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:26.402074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:26.411474 (+ 9400us) server_negotiation.cc:407] Connection header received
0811 18:59:26.411595 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:26.411596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:26.411607 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:26.411639 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:26.411826 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.412550 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.413870 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.414420 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.414477 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:26.414486 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:26.414707 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 18:59:26.414750 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 18:59:26.415036 28380 catalog_manager.cc:5495] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78d0ac2c89c34ccb9a3fac7d1b5da286 (127.5.226.65). New cstate: current_term: 1 leader_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 41525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "360284dd6e9046c79376c0f82f739b99" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ac24a4566dc409d9a82d25286b14b73" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41795 } health_report { overall_health: UNKNOWN } } }
I20260811 18:59:26.415277 29460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.401836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:41795 (local address 127.5.226.65:52555)
0811 18:59:26.411402 (+ 9566us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:26.411416 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:26.411506 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:26.411712 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:26.411713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:26.411715 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:26.411747 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:26.411749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.412689 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.412690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:26.413744 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:26.413748 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.414551 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.414552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:26.414617 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:26.414620 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:59:26.415109 (+ 489us) client_negotiation.cc:240] Negotiation successful
0811 18:59:26.415207 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9552,"thread_start_us":71,"threads_started":1}
I20260811 18:59:26.416162 28995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca1446f3f19148058263e52c52a20fcc" candidate_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac24a4566dc409d9a82d25286b14b73" is_pre_election: true
I20260811 18:59:26.416329 28995 raft_consensus.cc:2454] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78d0ac2c89c34ccb9a3fac7d1b5da286 in term 0.
I20260811 18:59:26.416450 29016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca1446f3f19148058263e52c52a20fcc" candidate_uuid: "78d0ac2c89c34ccb9a3fac7d1b5da286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac24a4566dc409d9a82d25286b14b73"
I20260811 18:59:26.416508 29016 raft_consensus.cc:3037] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:26.417461 29016 raft_consensus.cc:2454] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78d0ac2c89c34ccb9a3fac7d1b5da286 in term 1.
W20260811 18:59:26.433272 29112 tablet.cc:2369] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:59:26.454734 29431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.451263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40792 (local address 127.5.226.65:41525)
0811 18:59:26.451309 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:26.451311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:26.451330 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:59:26.451430 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:26.451431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:26.451454 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:26.451539 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:59:26.451710 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.452493 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.453748 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:26.454049 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:26.454115 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:26.454308 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:59:26.454464 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:59:26.454554 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:26.454618 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 18:59:26.454646 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:59:26.457168 29016 raft_consensus.cc:1261] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73 [term 1 FOLLOWER]: Refusing update from remote peer 78d0ac2c89c34ccb9a3fac7d1b5da286: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:59:26.457165 29268 raft_consensus.cc:1261] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99 [term 1 FOLLOWER]: Refusing update from remote peer 78d0ac2c89c34ccb9a3fac7d1b5da286: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:59:26.457566 29456 consensus_queue.cc:1035] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac24a4566dc409d9a82d25286b14b73" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 41795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:59:26.457727 29463 consensus_queue.cc:1035] T ca1446f3f19148058263e52c52a20fcc P 78d0ac2c89c34ccb9a3fac7d1b5da286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360284dd6e9046c79376c0f82f739b99" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:59:26.463132 29475 mvcc.cc:205] Tried to move back new op lower bound from 7317400643405479936 to 7317400643233087488. Current Snapshot: MvccSnapshot[applied={T|T < 7317400643405479936}]
I20260811 18:59:26.467929 28384 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:59:26.468058 28384 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:59:26.468865 28384 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a63486ddf37342e79c8c5d1a73820dd8: Sending DeleteTablet for 3 replicas of tablet ca1446f3f19148058263e52c52a20fcc
I20260811 18:59:26.469275 28693 tablet_service.cc:1514] Processing DeleteTablet for tablet ca1446f3f19148058263e52c52a20fcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:59:26 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:40784
I20260811 18:59:26.469561 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 28557
I20260811 18:59:26.469725 28930 tablet_service.cc:1514] Processing DeleteTablet for tablet ca1446f3f19148058263e52c52a20fcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:59:26 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:37408
W20260811 18:59:26.481607 29405 tablet.cc:2369] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:59:26.487089 29267 tablet_service.cc:1514] Processing DeleteTablet for tablet ca1446f3f19148058263e52c52a20fcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:59:26 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:59936
I20260811 18:59:26.487455 29476 mvcc.cc:205] Tried to move back new op lower bound from 7317400643405479936 to 7317400643233087488. Current Snapshot: MvccSnapshot[applied={T|T < 7317400643405479936}]
I20260811 18:59:26.488963 29491 tablet_replica.cc:330] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73: stopping tablet replica
I20260811 18:59:26.489149 29491 raft_consensus.cc:2229] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:59:26.489351 29491 raft_consensus.cc:2258] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:59:26.489533 29492 tablet_replica.cc:330] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99: stopping tablet replica
I20260811 18:59:26.489684 29492 raft_consensus.cc:2229] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:59:26.489841 29492 raft_consensus.cc:2258] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:59:26.490309 29492 ts_tablet_manager.cc:1905] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:59:26.490309 29491 ts_tablet_manager.cc:1905] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:59:26.492229 29492 ts_tablet_manager.cc:1918] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:59:26.492378 29492 log.cc:1196] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/ca1446f3f19148058263e52c52a20fcc
I20260811 18:59:26.492636 29491 ts_tablet_manager.cc:1918] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:59:26.492812 29491 log.cc:1196] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/ca1446f3f19148058263e52c52a20fcc
I20260811 18:59:26.493042 29492 ts_tablet_manager.cc:1939] T ca1446f3f19148058263e52c52a20fcc P 360284dd6e9046c79376c0f82f739b99: Deleting consensus metadata
I20260811 18:59:26.493129 29491 ts_tablet_manager.cc:1939] T ca1446f3f19148058263e52c52a20fcc P 7ac24a4566dc409d9a82d25286b14b73: Deleting consensus metadata
I20260811 18:59:26.493618 28351 catalog_manager.cc:4841] TS 7ac24a4566dc409d9a82d25286b14b73 (127.5.226.66:41795): tablet ca1446f3f19148058263e52c52a20fcc (table test-table [id=c99a1e17d75f4bfa832877f4b289bec6]) successfully deleted
I20260811 18:59:26.493737 28351 catalog_manager.cc:4841] TS 360284dd6e9046c79376c0f82f739b99 (127.5.226.67:34725): tablet ca1446f3f19148058263e52c52a20fcc (table test-table [id=c99a1e17d75f4bfa832877f4b289bec6]) successfully deleted
W20260811 18:59:26.498868 28348 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:41525 (error 108)
I20260811 18:59:26.499475 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 28836
I20260811 18:59:26.547099 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 29118
I20260811 18:59:26.590775 29430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.590604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:41525 (local address 127.0.0.1:40808)
0811 18:59:26.590668 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:26.590724 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:41525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 18:59:26.591081 28348 catalog_manager.cc:4584] TS 78d0ac2c89c34ccb9a3fac7d1b5da286 (127.5.226.65:41525): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ca1446f3f19148058263e52c52a20fcc: Network error: Client connection negotiation failed: client connection to 127.5.226.65:41525: connect: Connection refused (error 111)
I20260811 18:59:26.597908 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 28305
I20260811 18:59:26.614343 6025 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 18:59:26.960371 6025 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 18:59:26.960477 6025 mini_ranger.cc:66] Stopping Ranger...
I20260811 18:59:27.305044 6025 mini_ranger.cc:68] Stopped Ranger
2026-08-11 18:59:27.305 UTC [27493] LOG: received smart shutdown request
2026-08-11 18:59:27.308 UTC [27493] LOG: background worker "logical replication launcher" (PID 27505) exited with exit code 1
2026-08-11 18:59:27.309 UTC [27498] LOG: shutting down
2026-08-11 18:59:27.452 UTC [27493] LOG: database system is shut down
2026-08-11T18:59:27Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47350 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:27 dist-test-slave-gjw7 krb5kdc[29516](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:27 dist-test-slave-gjw7 krb5kdc[29516](info): set up 2 sockets
Aug 11 18:59:27 dist-test-slave-gjw7 krb5kdc[29516](info): commencing operation
krb5kdc: starting...
W20260811 18:59:28.762187 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 18:59:28 dist-test-slave-gjw7 krb5kdc[29516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:28Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.5.226.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.5.226.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/rangeradmin_127.5.226.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/rangeradmin_127.5.226.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.5.226.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.5.226.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/rangerlookup_127.5.226.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/rangerlookup_127.5.226.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.5.226.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.226.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/HTTP_127.5.226.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/HTTP_127.5.226.84@KRBTEST.COM.keytab.
I20260811 18:59:28.921774 6025 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskptszHt/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/postgres -l logfile start
2026-08-11 18:59:31.142 UTC [29586] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 18:59:31.143 UTC [29586] LOG: listening on IPv4 address "127.5.226.84", port 60871
2026-08-11 18:59:31.146 UTC [29586] LOG: listening on Unix socket "/tmp/.s.PGSQL.60871"
2026-08-11 18:59:31.174 UTC [29592] LOG: database system was shut down at 2026-08-11 18:59:29 UTC
2026-08-11 18:59:31.178 UTC [29586] LOG: database system is ready to accept connections
I20260811 18:59:32.311429 6025 mini_postgres.cc:96] Postgres bound to 60871
2026-08-11 18:59:32.318 UTC [29607] FATAL: database "slave" does not exist
127.5.226.84:60871 - accepting connections
I20260811 18:59:32.318862 6025 mini_ranger.cc:161] Starting Ranger...
I20260811 18:59:32.333420 6025 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 18:59:32.728250 6025 mini_ranger.cc:87] Created ranger Postgres database
I20260811 18:59:32.728343 6025 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-admin
2026-08-11 18:59:33,010 [I] DB FLAVOR :POSTGRES
2026-08-11 18:59:33,011 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:59:33,011 [I] Checking connection..
2026-08-11 18:59:33,011 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 18:59:33,273 [I] Checking connection passed.
2026-08-11 18:59:33,273 [I] --------- Verifying version history table ---------
2026-08-11 18:59:33,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:59:33,545 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:59:33,545 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:59:33,816 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:59:33,816 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 18:59:33,816 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 18:59:34.062 UTC [29723] WARNING: there is no transaction in progress
2026-08-11 18:59:34,071 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 18:59:34,071 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:59:34,337 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 18:59:34,337 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:59:34,337 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 18:59:34,597 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 18:59:34,832 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gjw7.c.gcp-upstream.internal','N') ;"
2026-08-11 18:59:35,085 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:59:35,340 [I] Table x_portal_user does not exist in database ranger
2026-08-11 18:59:35,340 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:59:35,597 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 18:59:35,597 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:59:35,860 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:59:36,093 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 18:59:36,093 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 18:59:37.026 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.042 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.057 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.072 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.091 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.108 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.160 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.166 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.180 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.189 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.199 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.212 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.221 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.227 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.232 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37.239 UTC [29951] WARNING: there is no transaction in progress
2026-08-11 18:59:37,804 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 18:59:37,804 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 18:59:38,046 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 18:59:38,047 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:59:38,295 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 18:59:38,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:59:38,556 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 18:59:38,557 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:59:38,801 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:59:39,041 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gjw7.c.gcp-upstream.internal';"
2026-08-11 18:59:39,279 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 18:59:39,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 18:59:39,523 [I] DB_PATCHES have already been applied
I20260811 18:59:39.529601 6025 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-admin:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskptszHt/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 18:59:39.529673 6025 mini_ranger.cc:193] Using host: 127.5.226.84
I20260811 18:59:39.533556 6025 mini_ranger.cc:227] Ranger admin URL: http://127.5.226.84:39273
Aug 11, 2026 6:59:39 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:59:39 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:59:39 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 6:59:39 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 6:59:39 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 6:59:40 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 6:59:40 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 18:59:40.845605 6025 mini_ranger.cc:160] Time spent starting Ranger: real 8.527s user 0.000s sys 0.009s
Aug 11, 2026 7:00:00 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 7:00:00 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 7:00:00 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 7:00:00 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 7:00:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 7:00:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 7:00:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 7:00:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 7:00:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 7:00:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 7:00:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 7:00:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 7:00:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 7:00:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 7:00:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 7:00:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 7:00:00 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 7:00:01 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 19:00:01.817864 6025 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.5.226.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.5.226.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/rangerkms_127.5.226.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.5.226.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/rangerkms_127.5.226.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.5.226.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.5.226.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.226.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/HTTP_127.5.226.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.5.226.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/HTTP_127.5.226.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 19:00:01 dist-test-slave-gjw7 krb5kdc[29516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474801, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 19:00:01.901901 6025 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 19:00:01.911635 6025 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 19:00:02.643194 6025 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 19:00:02.643280 6025 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-kms
I20260811 19:00:02.643296 6025 mini_ranger_kms.cc:227] Using postgres at 127.5.226.84:60871
2026-08-11 19:00:02,795 [I] DB FLAVOR :POSTGRES
2026-08-11 19:00:02,796 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 19:00:02,796 [I] Checking connection
2026-08-11 19:00:02,796 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 19:00:03,057 [I] connection success
2026-08-11 19:00:03,057 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 19:00:03,057 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 19:00:03,057 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 19:00:03,300 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 19:00:03,300 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 19:00:03,300 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 19:00:03,301 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.226.84:60871/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 19:00:03,598 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 19:00:04.079885 6025 mini_ranger_kms.cc:310] Created kms service
I20260811 19:00:04.273267 6025 mini_ranger_kms.cc:326] Created kudu user
I20260811 19:00:04.318181 6025 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 19:00:04 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474801, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 19:00:04.713557 6025 mini_ranger_kms.cc:384] Added ranger policy
I20260811 19:00:04.713685 6025 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-kms:/tmp/dist-test-taskptszHt/build/release/bin/postgresql.jar:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskptszHt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 19:00:04.713717 6025 mini_ranger_kms.cc:240] Using host: 127.5.226.84
I20260811 19:00:04.718011 6025 mini_ranger_kms.cc:276] Ranger KMS PID: 30369
I20260811 19:00:04.718096 6025 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.5.226.84:44807
Aug 11, 2026 7:00:05 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:00:05 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:00:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 7:00:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 7:00:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 7:00:06 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 19:00:06 dist-test-slave-gjw7 krb5kdc[29516](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474806, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.226.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 19:00:07 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474806, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.226.84@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 19:00:07.362466 6025 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.461s user 0.000s sys 0.136s
I20260811 19:00:07.362700 6025 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 19:00:07.362766 6025 mini_ranger_kms.cc:401] 127.5.226.84:44807/kms/v1/keys
Aug 11 19:00:07 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474806, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.226.84@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
Aug 11 19:00:09 dist-test-slave-gjw7 krb5kdc[29516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:00:09.921502 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:33089
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:33089
--ranger_config_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.226.84:44807/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:10.003973 30477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:10.004197 30477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:10.004220 30477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:10.005427 30477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:00:10.005470 30477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:10.005481 30477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:10.005493 30477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:00:10.005505 30477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:00:10.007146 30477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/wal
--ranger_kms_url=127.5.226.84:44807/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:33089
--ranger_config_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:33089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:10.007378 30477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:10.007592 30477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:10.012434 30490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:10.012465 30477 server_base.cc:1034] running on GCE node
W20260811 19:00:10.012492 30488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:10.012447 30494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:10.012804 30477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:10.013087 30477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:10.014235 30477 hybrid_clock.cc:648] HybridClock initialized: now 1786474810014195 us; error 56 us; skew 500 ppm
Aug 11 19:00:10 dist-test-slave-gjw7 krb5kdc[29516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474810, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:10.020680 30477 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:00:10.021154 30477 webserver.cc:460] Webserver started at http://127.5.226.126:38821/ using document root <none> and password file <none>
I20260811 19:00:10.021412 30477 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:10.021452 30477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:10.021571 30477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 19:00:10 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474810, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 19:00:10.067198 30477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "a77de94a61a14912ae1abac4536bf7cb"
format_stamp: "Formatted at 2026-08-11 19:00:10 on dist-test-slave-gjw7"
server_key: "183ba0d0521d365bd6e37cebada0812a"
server_key_iv: "ef0b42df32abb2fe1ccba028b8a3afdd"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:10.067607 30477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "a77de94a61a14912ae1abac4536bf7cb"
format_stamp: "Formatted at 2026-08-11 19:00:10 on dist-test-slave-gjw7"
server_key: "183ba0d0521d365bd6e37cebada0812a"
server_key_iv: "ef0b42df32abb2fe1ccba028b8a3afdd"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:10.068966 30477 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:00:10.080338 30506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:10.080531 30477 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 19:00:10.080607 30477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "a77de94a61a14912ae1abac4536bf7cb"
format_stamp: "Formatted at 2026-08-11 19:00:10 on dist-test-slave-gjw7"
server_key: "183ba0d0521d365bd6e37cebada0812a"
server_key_iv: "ef0b42df32abb2fe1ccba028b8a3afdd"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:10.080700 30477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:10.095858 30477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:10.097774 30477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:10.097922 30477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:10.102396 30477 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:33089
I20260811 19:00:10.102468 30617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:33089 every 8 connection(s)
I20260811 19:00:10.102802 30477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:00:10.103552 30618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:10.105885 30618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb: Bootstrap starting.
I20260811 19:00:10.106449 30618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:10.106719 30618 log.cc:824] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:10.107348 30618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb: No bootstrap required, opened a new log
I20260811 19:00:10.107602 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 30477
I20260811 19:00:10.107721 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:00:10.107937 6025 external_mini_cluster.cc:1428] Setting key 32118afa78371c71fcc956c1878aab00
I20260811 19:00:10.109994 30618 raft_consensus.cc:348] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77de94a61a14912ae1abac4536bf7cb" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33089 } }
I20260811 19:00:10.110136 30618 raft_consensus.cc:374] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:10.110169 30618 raft_consensus.cc:729] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a77de94a61a14912ae1abac4536bf7cb, State: Initialized, Role: FOLLOWER
I20260811 19:00:10.110351 30618 consensus_queue.cc:260] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77de94a61a14912ae1abac4536bf7cb" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33089 } }
I20260811 19:00:10.110440 30618 raft_consensus.cc:388] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:00:10.110481 30618 raft_consensus.cc:482] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:00:10.110534 30618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:10.111078 30618 raft_consensus.cc:504] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77de94a61a14912ae1abac4536bf7cb" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33089 } }
I20260811 19:00:10.111182 30618 leader_election.cc:302] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a77de94a61a14912ae1abac4536bf7cb; no voters:
I20260811 19:00:10.111368 30618 leader_election.cc:288] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:00:10.111413 30625 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:00:10.111634 30625 raft_consensus.cc:686] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 1 LEADER]: Becoming Leader. State: Replica: a77de94a61a14912ae1abac4536bf7cb, State: Running, Role: LEADER
I20260811 19:00:10.111713 30618 sys_catalog.cc:564] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:00:10.111768 30625 consensus_queue.cc:237] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77de94a61a14912ae1abac4536bf7cb" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33089 } }
I20260811 19:00:10.112200 30625 sys_catalog.cc:455] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a77de94a61a14912ae1abac4536bf7cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77de94a61a14912ae1abac4536bf7cb" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33089 } } }
I20260811 19:00:10.112354 30625 sys_catalog.cc:458] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:10.112531 30625 sys_catalog.cc:455] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader a77de94a61a14912ae1abac4536bf7cb. Latest consensus state: current_term: 1 leader_uuid: "a77de94a61a14912ae1abac4536bf7cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77de94a61a14912ae1abac4536bf7cb" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33089 } } }
I20260811 19:00:10.112633 30625 sys_catalog.cc:458] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:10.112804 30642 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:00:10.113144 30618 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 19:00:10.113350 30642 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 19:00:10 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:10.121568 30623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:10.108484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35760 (local address 127.5.226.126:33089)
0811 19:00:10.108679 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:10.108689 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:10.108721 (+ 32us) server_negotiation.cc:407] Connection header received
0811 19:00:10.109578 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:10.109589 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:10.109656 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:10.109824 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:10.110566 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:10.111963 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:10.113021 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:10.113621 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:10.113729 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:10.116863 (+ 3134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:10.116907 (+ 44us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:10.116907 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:10.117014 (+ 107us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:10.119466 (+ 2452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:10.119883 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:10.119886 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:10.119887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:10.119986 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:10.120193 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:10.120193 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:10.120194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:10.120530 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:10.120678 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:10.121128 (+ 450us) server_negotiation.cc:299] Negotiation successful
0811 19:00:10.121320 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":98,"threads_started":1}
I20260811 19:00:10.125542 30642 catalog_manager.cc:1347] Generated new cluster ID: 435d0e6e536846849c90828a78317738
I20260811 19:00:10.125603 30642 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:00:10.144156 30642 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:00:10.145015 30642 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:00:10.148396 30642 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb: Generated new TSK 0
I20260811 19:00:10.148650 30642 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 19:00:10.884527 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.226.84:44807/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33089
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:10.971212 30703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:10.971421 30703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:10.971454 30703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:10.972638 30703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:10.972680 30703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:10.972724 30703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 19:00:10.974300 30703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.5.226.84:44807/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:10.974545 30703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:10.974776 30703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:10.979957 30713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:10.979933 30717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:10.980250 30712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:10.980429 30703 server_base.cc:1034] running on GCE node
I20260811 19:00:10.980701 30703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:10.980969 30703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:10.982120 30703 hybrid_clock.cc:648] HybridClock initialized: now 1786474810982102 us; error 35 us; skew 500 ppm
Aug 11 19:00:10 dist-test-slave-gjw7 krb5kdc[29516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474810, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:10.984848 30703 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 19:00:10.985323 30703 webserver.cc:460] Webserver started at http://127.5.226.65:35781/ using document root <none> and password file <none>
I20260811 19:00:10.985564 30703 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:10.985618 30703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:10.985754 30703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 19:00:10 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474810, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 19:00:10.999604 30703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "56238ae24b2e4bb7bdba2f41a87d3393"
format_stamp: "Formatted at 2026-08-11 19:00:10 on dist-test-slave-gjw7"
server_key: "fe4025a9591583d5aacaf7b0c7b9a6c2"
server_key_iv: "993aa8c77549435f598e61f32e9ac2d0"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:11.000046 30703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "56238ae24b2e4bb7bdba2f41a87d3393"
format_stamp: "Formatted at 2026-08-11 19:00:10 on dist-test-slave-gjw7"
server_key: "fe4025a9591583d5aacaf7b0c7b9a6c2"
server_key_iv: "993aa8c77549435f598e61f32e9ac2d0"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:11.003166 30703 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 19:00:11.017469 30728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:11.020733 30703 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260811 19:00:11.020862 30703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "56238ae24b2e4bb7bdba2f41a87d3393"
format_stamp: "Formatted at 2026-08-11 19:00:10 on dist-test-slave-gjw7"
server_key: "fe4025a9591583d5aacaf7b0c7b9a6c2"
server_key_iv: "993aa8c77549435f598e61f32e9ac2d0"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:11.020972 30703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:11.034602 30703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:11.036928 30703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:11.037081 30703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:11.037374 30703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:11.037760 30703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:11.037808 30703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:11.037849 30703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:11.037871 30703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:11.045348 30703 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:36805
I20260811 19:00:11.045439 30967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:36805 every 8 connection(s)
I20260811 19:00:11.045923 30703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 19:00:11.047389 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 30703
I20260811 19:00:11.047498 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 19:00:11.047705 6025 external_mini_cluster.cc:1428] Setting key d46a0f83733fa9ff80e0dd9aed938ce8
Aug 11 19:00:11 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474810, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:11.057787 30974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:11.046764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:49597 (local address 127.5.226.126:33089)
0811 19:00:11.047959 (+ 1195us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:11.047961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:11.047970 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:00:11.047997 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:11.047998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:11.048010 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:11.048825 (+ 815us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:11.048865 (+ 40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:11.049704 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:11.051203 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:11.051536 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:11.052651 (+ 1115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:11.054296 (+ 1645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:11.054298 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:11.054298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:11.054306 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:11.056056 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:11.056580 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:11.056581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:11.056582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:11.056651 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:11.056956 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:11.056957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:11.056958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:11.057105 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:11.057151 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:11.057577 (+ 426us) server_negotiation.cc:299] Negotiation successful
0811 19:00:11.057671 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1164,"thread_start_us":93,"threads_started":1}
I20260811 19:00:11.058452 30972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:11.046707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33089 (local address 127.5.226.65:49597)
0811 19:00:11.046980 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:11.047023 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:11.047661 (+ 638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:11.048182 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:11.048187 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:11.048445 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:11.048728 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:11.048735 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:11.049811 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:11.049813 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:11.051102 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:11.051105 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:11.051641 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:11.051642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:11.051796 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:11.052419 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:11.052430 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:11.054199 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:11.056170 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:11.056178 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:11.056181 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:11.056487 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:11.056721 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:11.056722 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:11.056722 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:11.056873 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:11.057198 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:11.057205 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:11.057406 (+ 201us) client_negotiation.cc:769] Sending connection context
0811 19:00:11.058031 (+ 625us) client_negotiation.cc:240] Negotiation successful
0811 19:00:11.058210 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":90,"threads_started":1}
I20260811 19:00:11.059120 30969 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33089
I20260811 19:00:11.059252 30969 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:11.059468 30969 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
I20260811 19:00:11.060138 30541 ts_manager.cc:194] Registered new tserver with Master: 56238ae24b2e4bb7bdba2f41a87d3393 (127.5.226.65:36805)
I20260811 19:00:11.061018 30541 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:49597
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 19:00:11.078321 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.226.84:44807/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33089
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:11.195964 30979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:11.196244 30979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:11.196278 30979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:11.198024 30979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:11.198089 30979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:11.198130 30979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
Aug 11 19:00:11 dist-test-slave-gjw7 krb5kdc[29516](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474811, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:11.200320 30979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.5.226.84:44807/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:11.200582 30979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:11.200923 30979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:11.210949 30992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:11.211251 30989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:11.211840 30988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:11.212875 30979 server_base.cc:1034] running on GCE node
I20260811 19:00:11.213207 30979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:11.213660 30979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:11.214898 30979 hybrid_clock.cc:648] HybridClock initialized: now 1786474811214876 us; error 34 us; skew 500 ppm
Aug 11 19:00:11 dist-test-slave-gjw7 krb5kdc[29516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474811, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:11.218384 30979 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 19:00:11.218973 30979 webserver.cc:460] Webserver started at http://127.5.226.66:34767/ using document root <none> and password file <none>
I20260811 19:00:11.219239 30979 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:11.219293 30979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:11.219424 30979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 19:00:11 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474811, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 19:00:11.234553 30979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "f6c30bbeda9445c8a8e9f0fdc271330b"
format_stamp: "Formatted at 2026-08-11 19:00:11 on dist-test-slave-gjw7"
server_key: "ba051e26ada1ac63a21fdded47a554cb"
server_key_iv: "5f23c3e24955d1244886894f30f770e7"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:11.235126 30979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "f6c30bbeda9445c8a8e9f0fdc271330b"
format_stamp: "Formatted at 2026-08-11 19:00:11 on dist-test-slave-gjw7"
server_key: "ba051e26ada1ac63a21fdded47a554cb"
server_key_iv: "5f23c3e24955d1244886894f30f770e7"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:11.241573 30979 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.000s
I20260811 19:00:11.259178 31010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:11.264621 30979 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.001s sys 0.000s
I20260811 19:00:11.264787 30979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "f6c30bbeda9445c8a8e9f0fdc271330b"
format_stamp: "Formatted at 2026-08-11 19:00:11 on dist-test-slave-gjw7"
server_key: "ba051e26ada1ac63a21fdded47a554cb"
server_key_iv: "5f23c3e24955d1244886894f30f770e7"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:11.264915 30979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:11.282019 30979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:11.284444 30979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:11.284584 30979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:11.284814 30979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:11.285159 30979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:11.285209 30979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:11.285239 30979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:11.285255 30979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:11.291586 30979 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:40399
I20260811 19:00:11.292012 30979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 19:00:11.293498 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 30979
I20260811 19:00:11.293603 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 19:00:11.293813 6025 external_mini_cluster.cc:1428] Setting key 902f340c878b86498835f7c76d8f7ee1
I20260811 19:00:11.301710 31253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:40399 every 8 connection(s)
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Aug 11 19:00:11 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474811, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:11.320931 30974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:11.302435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:50271 (local address 127.5.226.126:33089)
0811 19:00:11.302488 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:11.302490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:11.309598 (+ 7108us) server_negotiation.cc:407] Connection header received
0811 19:00:11.310385 (+ 787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:11.310387 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:11.310406 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:11.310438 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:11.311445 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:11.312283 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:11.314625 (+ 2342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:11.314944 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:11.314992 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:11.317755 (+ 2763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:11.317756 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:11.317757 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:11.317764 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:11.319393 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:11.319878 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:11.319879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:11.319880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:11.319940 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:11.320198 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:11.320199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:11.320200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:11.320348 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:11.320396 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:11.320739 (+ 343us) server_negotiation.cc:299] Negotiation successful
0811 19:00:11.320829 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 19:00:11.321745 31262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:11.302437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33089 (local address 127.5.226.66:50271)
0811 19:00:11.309403 (+ 6966us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:11.309471 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:11.310236 (+ 765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:11.310645 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:11.310650 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:11.310907 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:11.311325 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:11.311333 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:11.312432 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:11.312433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:11.313755 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:11.313759 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:11.315102 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:11.315103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:11.315274 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:11.315878 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:11.315888 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:11.317642 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:11.319504 (+ 1862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:11.319511 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:11.319514 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:11.319791 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:11.320002 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:11.320003 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:11.320003 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:11.320132 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:11.320429 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:11.320436 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:11.320593 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 19:00:11.321326 (+ 733us) client_negotiation.cc:240] Negotiation successful
0811 19:00:11.321494 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6901,"thread_start_us":112,"threads_started":1}
I20260811 19:00:11.322677 31257 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33089
I20260811 19:00:11.322785 31257 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:11.322995 31257 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
I20260811 19:00:11.323510 30541 ts_manager.cc:194] Registered new tserver with Master: f6c30bbeda9445c8a8e9f0fdc271330b (127.5.226.66:40399)
I20260811 19:00:11.324000 30541 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:50271
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 19:00:11.340710 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.226.84:44807/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33089
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:11.462303 31267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:11.462667 31267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:11.462772 31267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:11.464558 31267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:11.464663 31267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:11.464749 31267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 19:00:11.467083 31267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.5.226.84:44807/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:11.467581 31267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:11.467934 31267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:11.475776 31278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:11.475806 31277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:11.476082 31282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:11.478400 31267 server_base.cc:1034] running on GCE node
I20260811 19:00:11.478606 31267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:11.478845 31267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:11.479996 31267 hybrid_clock.cc:648] HybridClock initialized: now 1786474811479984 us; error 25 us; skew 500 ppm
Aug 11 19:00:11 dist-test-slave-gjw7 krb5kdc[29516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474811, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:11.482497 31267 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 19:00:11.482904 31267 webserver.cc:460] Webserver started at http://127.5.226.67:36365/ using document root <none> and password file <none>
I20260811 19:00:11.483131 31267 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:11.483181 31267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:11.483325 31267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 19:00:11 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474811, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 19:00:11.495455 31267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "9be8d84180e948569f7f26a24ea0654d"
format_stamp: "Formatted at 2026-08-11 19:00:11 on dist-test-slave-gjw7"
server_key: "8f3c9a12158fedebdb7dc977d413f3dd"
server_key_iv: "dd9b3b70731101b3ed7cdda9df4ae0b9"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:11.496040 31267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "9be8d84180e948569f7f26a24ea0654d"
format_stamp: "Formatted at 2026-08-11 19:00:11 on dist-test-slave-gjw7"
server_key: "8f3c9a12158fedebdb7dc977d413f3dd"
server_key_iv: "dd9b3b70731101b3ed7cdda9df4ae0b9"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:11.498529 31267 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 19:00:11.519826 31295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:11.520802 31267 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 19:00:11.520926 31267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "9be8d84180e948569f7f26a24ea0654d"
format_stamp: "Formatted at 2026-08-11 19:00:11 on dist-test-slave-gjw7"
server_key: "8f3c9a12158fedebdb7dc977d413f3dd"
server_key_iv: "dd9b3b70731101b3ed7cdda9df4ae0b9"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:11.521039 31267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:11.532719 31267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:11.535094 31267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:11.535247 31267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:11.535483 31267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:11.535884 31267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:11.535954 31267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:11.535992 31267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:11.536012 31267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:11.543021 31267 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:44053
I20260811 19:00:11.543484 31267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 19:00:11.544716 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 31267
I20260811 19:00:11.544821 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 19:00:11.545017 6025 external_mini_cluster.cc:1428] Setting key a516b0383fa5c7c1f157e35dfe39d9f7
I20260811 19:00:11.546821 31542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:44053 every 8 connection(s)
Aug 11 19:00:11 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474811, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:11.558667 30974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:11.547717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:58823 (local address 127.5.226.126:33089)
0811 19:00:11.547763 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:11.547765 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:11.548073 (+ 308us) server_negotiation.cc:407] Connection header received
0811 19:00:11.548787 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:11.548789 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:11.548801 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:11.548830 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:11.549731 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:11.550520 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:11.552025 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:11.552338 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:11.552379 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:11.555100 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:11.555102 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:11.555102 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:11.555111 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:11.556974 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:11.557524 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:11.557526 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:11.557526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:11.557592 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:11.557892 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:11.557893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:11.557893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:11.558038 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:11.558090 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:11.558476 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 19:00:11.558567 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 19:00:11.559206 31546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:11.547434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33089 (local address 127.5.226.67:58823)
0811 19:00:11.547930 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:11.547982 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:11.548646 (+ 664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:11.549019 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:11.549024 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:11.549283 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:11.549608 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:11.549616 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:11.550638 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:11.550639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:11.551922 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:11.551926 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:11.552482 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:11.552483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:11.552632 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:11.553254 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:11.553265 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:11.554988 (+ 1723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:11.557073 (+ 2085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:11.557081 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:11.557084 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:11.557431 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:11.557659 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:11.557660 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:11.557661 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:11.557817 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:11.558124 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:11.558131 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:11.558303 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 19:00:11.558789 (+ 486us) client_negotiation.cc:240] Negotiation successful
0811 19:00:11.558966 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":92,"threads_started":1}
I20260811 19:00:11.560110 31543 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33089
I20260811 19:00:11.560221 31543 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:11.560429 31543 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
I20260811 19:00:11.560860 30541 ts_manager.cc:194] Registered new tserver with Master: 9be8d84180e948569f7f26a24ea0654d (127.5.226.67:44053)
I20260811 19:00:11.561414 30541 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:58823
I20260811 19:00:11.567963 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 19:00:11.568809 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 30703
I20260811 19:00:11.647835 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 30979
I20260811 19:00:11.688555 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 31267
Aug 11 19:00:11 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474811, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 19:00:11.698661 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 30477
I20260811 19:00:11.715982 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:33089
--webserver_interface=127.5.226.126
--webserver_port=38821
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:33089
--ranger_config_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.226.84:44807/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.5.226.84:44807/kms with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:11.798202 31549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:11.798414 31549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:11.798435 31549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:11.799512 31549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:00:11.799546 31549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:11.799558 31549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:11.799569 31549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:00:11.799587 31549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:00:11.801163 31549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.5.226.84:44807/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:33089
--ranger_config_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:33089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=38821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:11.801404 31549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:11.801594 31549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:11.806231 31564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:11.806244 31562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:11.806358 31549 server_base.cc:1034] running on GCE node
W20260811 19:00:11.806214 31566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:11.806694 31549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:11.806981 31549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:11.808136 31549 hybrid_clock.cc:648] HybridClock initialized: now 1786474811808122 us; error 28 us; skew 500 ppm
Aug 11 19:00:11 dist-test-slave-gjw7 krb5kdc[29516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474811, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:11.810559 31549 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:00:11.810977 31549 webserver.cc:460] Webserver started at http://127.5.226.126:38821/ using document root <none> and password file <none>
I20260811 19:00:11.811164 31549 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:11.811211 31549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 19:00:11 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474811, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 19:00:11.848856 31549 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 19:00:11.849793 31583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:11.849967 31549 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 19:00:11.850054 31549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "a77de94a61a14912ae1abac4536bf7cb"
format_stamp: "Formatted at 2026-08-11 19:00:10 on dist-test-slave-gjw7"
server_key: "183ba0d0521d365bd6e37cebada0812a"
server_key_iv: "ef0b42df32abb2fe1ccba028b8a3afdd"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:11.850426 31549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:11.863353 31549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:11.865319 31549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:11.865468 31549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:11.869576 31549 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:33089
I20260811 19:00:11.869639 31698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:33089 every 8 connection(s)
I20260811 19:00:11.870033 31549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:00:11.871274 31699 sys_catalog.cc:263] Verifying existing consensus state
I20260811 19:00:11.871626 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 31549
I20260811 19:00:11.871948 31699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb: Bootstrap starting.
I20260811 19:00:11.871953 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.226.84:44807/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:36805
--local_ip_for_outbound_sockets=127.5.226.65
--tserver_master_addrs=127.5.226.126:33089
--webserver_port=35781
--webserver_interface=127.5.226.65
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.5.226.84:44807/kms with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:00:11.880899 31699 log.cc:824] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:11.883773 31699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 19:00:11.884083 31699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb: Bootstrap complete.
I20260811 19:00:11.887390 31699 raft_consensus.cc:348] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77de94a61a14912ae1abac4536bf7cb" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33089 } }
I20260811 19:00:11.887745 31699 raft_consensus.cc:729] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a77de94a61a14912ae1abac4536bf7cb, State: Initialized, Role: FOLLOWER
I20260811 19:00:11.887960 31699 consensus_queue.cc:260] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77de94a61a14912ae1abac4536bf7cb" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33089 } }
I20260811 19:00:11.888039 31699 raft_consensus.cc:388] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:00:11.888083 31699 raft_consensus.cc:482] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:00:11.888120 31699 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 1 FOLLOWER]: Advancing to term 2
I20260811 19:00:11.889485 31699 raft_consensus.cc:504] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77de94a61a14912ae1abac4536bf7cb" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33089 } }
I20260811 19:00:11.889600 31699 leader_election.cc:302] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a77de94a61a14912ae1abac4536bf7cb; no voters:
I20260811 19:00:11.889779 31699 leader_election.cc:288] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 19:00:11.889890 31706 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 2 FOLLOWER]: Leader election won for term 2
I20260811 19:00:11.890028 31699 sys_catalog.cc:564] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:00:11.890146 31706 raft_consensus.cc:686] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [term 2 LEADER]: Becoming Leader. State: Replica: a77de94a61a14912ae1abac4536bf7cb, State: Running, Role: LEADER
I20260811 19:00:11.890297 31706 consensus_queue.cc:237] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77de94a61a14912ae1abac4536bf7cb" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33089 } }
I20260811 19:00:11.890601 31706 sys_catalog.cc:455] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a77de94a61a14912ae1abac4536bf7cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77de94a61a14912ae1abac4536bf7cb" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33089 } } }
I20260811 19:00:11.890720 31706 sys_catalog.cc:458] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:11.890887 31706 sys_catalog.cc:455] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader a77de94a61a14912ae1abac4536bf7cb. Latest consensus state: current_term: 2 leader_uuid: "a77de94a61a14912ae1abac4536bf7cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77de94a61a14912ae1abac4536bf7cb" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33089 } } }
I20260811 19:00:11.890977 31706 sys_catalog.cc:458] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:11.891496 31699 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 19:00:11.894217 31728 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:00:11.894971 31728 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:00:11.895125 31728 catalog_manager.cc:1259] Loaded cluster ID: 435d0e6e536846849c90828a78317738
I20260811 19:00:11.895153 31728 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:00:11.897013 31728 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:00:11.897282 31728 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb: Loaded TSK: 0
I20260811 19:00:11.897567 31728 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 19:00:11.982391 31701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:11.982743 31701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:11.982822 31701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:11.984527 31701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:11.984582 31701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:11.984623 31701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 19:00:11.986837 31701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.5.226.84:44807/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:36805
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=35781
--tserver_master_addrs=127.5.226.126:33089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:11.987177 31701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:11.987447 31701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:11.993677 31781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:11.994086 31777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:11.994354 31701 server_base.cc:1034] running on GCE node
W20260811 19:00:11.993718 31778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:11.994800 31701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:11.995070 31701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:11.998531 31701 hybrid_clock.cc:648] HybridClock initialized: now 1786474811998498 us; error 45 us; skew 500 ppm
Aug 11 19:00:11 dist-test-slave-gjw7 krb5kdc[29516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474811, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:12.001752 31701 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 19:00:12.002293 31701 webserver.cc:460] Webserver started at http://127.5.226.65:35781/ using document root <none> and password file <none>
I20260811 19:00:12.002547 31701 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:12.002626 31701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 19:00:12 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474811, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 19:00:12.022163 31701 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 19:00:12.029471 31797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:12.029701 31701 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.000s sys 0.000s
I20260811 19:00:12.029801 31701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "56238ae24b2e4bb7bdba2f41a87d3393"
format_stamp: "Formatted at 2026-08-11 19:00:10 on dist-test-slave-gjw7"
server_key: "fe4025a9591583d5aacaf7b0c7b9a6c2"
server_key_iv: "993aa8c77549435f598e61f32e9ac2d0"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:12.030330 31701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:12.093957 31701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:12.096412 31701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:12.096577 31701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:12.096856 31701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:12.097262 31701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:12.097340 31701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:12.097383 31701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:12.097405 31701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:12.104583 31701 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:36805
I20260811 19:00:12.105086 31701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 19:00:12.105479 32021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:36805 every 8 connection(s)
I20260811 19:00:12.113453 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 31701
I20260811 19:00:12.113781 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.226.84:44807/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:40399
--local_ip_for_outbound_sockets=127.5.226.66
--tserver_master_addrs=127.5.226.126:33089
--webserver_port=34767
--webserver_interface=127.5.226.66
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.5.226.84:44807/kms with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 19:00:12 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474811, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:12.118748 32030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:12.105990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:59689 (local address 127.5.226.126:33089)
0811 19:00:12.106299 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:12.106310 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:12.107243 (+ 933us) server_negotiation.cc:407] Connection header received
0811 19:00:12.107421 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:12.107429 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:12.107488 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:12.107637 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:12.108208 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:12.109683 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:12.111172 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:12.111800 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:12.111905 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:12.114545 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:12.114550 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:12.114550 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:12.114563 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:12.116601 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:12.117112 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:12.117116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:12.117116 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:12.117242 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:12.117582 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:12.117584 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:12.117584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:12.117894 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:12.117957 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:12.118393 (+ 436us) server_negotiation.cc:299] Negotiation successful
0811 19:00:12.118528 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":90,"threads_started":1}
I20260811 19:00:12.119251 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:12.105902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33089 (local address 127.5.226.65:59689)
0811 19:00:12.106389 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:12.106434 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:12.107068 (+ 634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:12.107696 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:12.107700 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:12.107891 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:12.108077 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:12.108081 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:12.109812 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:12.109813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:12.111069 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:12.111072 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:12.112016 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:12.112017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:12.112150 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:12.112740 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:12.112750 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:12.114420 (+ 1670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:12.116694 (+ 2274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:12.116702 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:12.116704 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:12.117003 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:12.117345 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:12.117346 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:12.117346 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:12.117496 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:12.118011 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:12.118030 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:12.118183 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 19:00:12.118874 (+ 691us) client_negotiation.cc:240] Negotiation successful
0811 19:00:12.119029 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":94,"threads_started":1}
I20260811 19:00:12.120023 32024 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33089
I20260811 19:00:12.120126 32024 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:12.120302 32024 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
W20260811 19:00:12.121177 32024 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:33089 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 19:00:12.121361 32024 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:12.121484 32024 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
I20260811 19:00:12.121860 32024 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:12.121990 32024 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
W20260811 19:00:12.122279 32024 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 19:00:12.237564 32032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:12.237845 32032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:12.237886 32032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:12.239490 32032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:12.239547 32032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:12.239581 32032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 19:00:12.241670 32032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.5.226.84:44807/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:40399
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=34767
--tserver_master_addrs=127.5.226.126:33089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:12.241914 32032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:12.242383 32032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:12.248903 32042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:12.249148 32048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:12.249307 32041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:12.249475 32032 server_base.cc:1034] running on GCE node
I20260811 19:00:12.249758 32032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:12.250047 32032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:12.251255 32032 hybrid_clock.cc:648] HybridClock initialized: now 1786474812251227 us; error 44 us; skew 500 ppm
Aug 11 19:00:12 dist-test-slave-gjw7 krb5kdc[29516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474812, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:12.254557 32032 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 19:00:12.255131 32032 webserver.cc:460] Webserver started at http://127.5.226.66:34767/ using document root <none> and password file <none>
I20260811 19:00:12.255424 32032 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:12.255518 32032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 19:00:12 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474812, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 19:00:12.271814 32032 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:00:12.276357 32063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:12.276615 32032 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s
I20260811 19:00:12.276741 32032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "f6c30bbeda9445c8a8e9f0fdc271330b"
format_stamp: "Formatted at 2026-08-11 19:00:11 on dist-test-slave-gjw7"
server_key: "ba051e26ada1ac63a21fdded47a554cb"
server_key_iv: "5f23c3e24955d1244886894f30f770e7"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:12.277359 32032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:12.293437 32032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:12.295620 32032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:12.295802 32032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:12.296108 32032 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:12.296518 32032 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:12.296574 32032 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:12.296613 32032 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:12.296636 32032 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:12.304255 32032 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:40399
I20260811 19:00:12.304294 32290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:40399 every 8 connection(s)
I20260811 19:00:12.304765 32032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
Aug 11 19:00:12 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474812, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:12.313745 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 32032
I20260811 19:00:12.314024 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.226.84:44807/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:44053
--local_ip_for_outbound_sockets=127.5.226.67
--tserver_master_addrs=127.5.226.126:33089
--webserver_port=36365
--webserver_interface=127.5.226.67
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.5.226.84:44807/kms with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:00:12.314886 32030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:12.305611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:33439 (local address 127.5.226.126:33089)
0811 19:00:12.305672 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:12.305675 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:12.305837 (+ 162us) server_negotiation.cc:407] Connection header received
0811 19:00:12.306327 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:12.306329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:12.306346 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:12.306425 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:12.306950 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:12.307738 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:12.308717 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:12.308930 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:12.308988 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:12.311488 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:12.311490 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:12.311491 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:12.311499 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:12.313154 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:12.313750 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:12.313752 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:12.313752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:12.313820 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:12.314116 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:12.314117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:12.314117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:12.314270 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:12.314314 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:12.314695 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 19:00:12.314793 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 19:00:12.315042 32297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:12.305555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33089 (local address 127.5.226.66:33439)
0811 19:00:12.305713 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:12.305757 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:12.306223 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:12.306484 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:12.306488 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:12.306660 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:12.306854 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:12.306859 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:12.307818 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:12.307818 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:12.308633 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:12.308636 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:12.309022 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:12.309024 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:12.309140 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:12.309806 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:12.309816 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:12.311388 (+ 1572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:12.313256 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:12.313263 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:12.313266 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:12.313655 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:12.313897 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:12.313898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:12.313899 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:12.314038 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:12.314363 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:12.314370 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:12.314532 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 19:00:12.314649 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 19:00:12.314810 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":84,"threads_started":1}
I20260811 19:00:12.315623 32294 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33089
I20260811 19:00:12.315737 32294 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:12.315946 32294 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
W20260811 19:00:12.316658 32294 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:33089 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 19:00:12.316726 32294 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:12.316787 32294 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
I20260811 19:00:12.317134 32294 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:12.317207 32294 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
W20260811 19:00:12.317622 32294 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 19:00:12.427609 32298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:12.428004 32298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:12.428105 32298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:12.429872 32298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:12.429981 32298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:12.430066 32298 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 19:00:12.432257 32298 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.5.226.84:44807/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:44053
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=36365
--tserver_master_addrs=127.5.226.126:33089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:12.432700 32298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:12.433035 32298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:12.440274 32316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:12.440536 32322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:12.440766 32320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:12.441522 32298 server_base.cc:1034] running on GCE node
I20260811 19:00:12.442022 32298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:12.442327 32298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:12.443491 32298 hybrid_clock.cc:648] HybridClock initialized: now 1786474812443462 us; error 41 us; skew 500 ppm
Aug 11 19:00:12 dist-test-slave-gjw7 krb5kdc[29516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474812, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:12.446794 32298 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 19:00:12.447346 32298 webserver.cc:460] Webserver started at http://127.5.226.67:36365/ using document root <none> and password file <none>
I20260811 19:00:12.447638 32298 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:12.447762 32298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 19:00:12 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474812, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 19:00:12.466207 32298 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:00:12.469722 32343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:12.469888 32298 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 19:00:12.469975 32298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "9be8d84180e948569f7f26a24ea0654d"
format_stamp: "Formatted at 2026-08-11 19:00:11 on dist-test-slave-gjw7"
server_key: "8f3c9a12158fedebdb7dc977d413f3dd"
server_key_iv: "dd9b3b70731101b3ed7cdda9df4ae0b9"
server_key_version: "kuduclusterkey@0"
I20260811 19:00:12.471239 32298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:12.487476 32298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:12.489707 32298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:12.489877 32298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:12.490161 32298 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:12.490567 32298 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:12.490617 32298 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:12.490656 32298 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:12.490677 32298 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:12.498032 32298 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:44053
I20260811 19:00:12.498437 32298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 19:00:12.499009 32577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:44053 every 8 connection(s)
I20260811 19:00:12.503669 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 32298
Aug 11 19:00:12 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474812, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:12.508337 32585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:12.499163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33089 (local address 127.5.226.67:54303)
0811 19:00:12.499338 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:12.499381 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:12.499914 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:12.500168 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:12.500172 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:12.500352 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:12.500545 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:12.500550 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:12.501231 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:12.501232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:12.502250 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:12.502254 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:12.502694 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:12.502696 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:12.502829 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:12.503403 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:12.503414 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:12.504866 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:12.506676 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:12.506684 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:12.506686 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:12.507005 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:12.507230 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:12.507231 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:12.507231 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:12.507375 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:12.507639 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:12.507645 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:12.507813 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 19:00:12.507926 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 19:00:12.508085 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":85,"threads_started":1}
I20260811 19:00:12.509035 32030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:12.499477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:54303 (local address 127.5.226.126:33089)
0811 19:00:12.499549 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:12.499551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:12.499561 (+ 10us) server_negotiation.cc:407] Connection header received
0811 19:00:12.500030 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:12.500031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:12.500045 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:12.500096 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:12.500645 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:12.501144 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:12.502345 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:12.502548 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:12.502604 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:12.504951 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:12.504952 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:12.504953 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:12.504960 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:12.506585 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:12.507093 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:12.507094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:12.507094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:12.507164 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:12.507442 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:12.507443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:12.507443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:12.507569 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:12.507634 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:12.508856 (+ 1222us) server_negotiation.cc:299] Negotiation successful
0811 19:00:12.508945 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 19:00:12.509763 32580 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33089
I20260811 19:00:12.509863 32580 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:12.510059 32580 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
W20260811 19:00:12.510810 32580 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:33089 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 19:00:12.510885 32580 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:12.510953 32580 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
I20260811 19:00:12.511262 32580 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:12.511341 32580 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
I20260811 19:00:12.511364 32586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:12.504081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35772 (local address 127.5.226.126:33089)
0811 19:00:12.504212 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:12.504214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:12.504394 (+ 180us) server_negotiation.cc:407] Connection header received
0811 19:00:12.504499 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:12.504500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:12.504512 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:12.504554 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:12.505617 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:12.506326 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:12.507178 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:12.507435 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:12.507473 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:12.508617 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:12.508619 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:12.508619 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:12.508626 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:12.510112 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:12.510544 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:12.510545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:12.510545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:12.510616 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:12.510821 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:12.510822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:12.510822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:12.510956 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:12.511124 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:12.511185 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 19:00:12.511269 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":69,"threads_started":1}
W20260811 19:00:12.511721 32580 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 19:00:12 dist-test-slave-gjw7 krb5kdc[29516](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474812, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:13.122459 32024 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:13.122605 32024 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
I20260811 19:00:13.123018 31613 ts_manager.cc:194] Registered new tserver with Master: 56238ae24b2e4bb7bdba2f41a87d3393 (127.5.226.65:36805)
I20260811 19:00:13.123867 31613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:59689
I20260811 19:00:13.317795 32294 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:13.317950 32294 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
I20260811 19:00:13.318231 31613 ts_manager.cc:194] Registered new tserver with Master: f6c30bbeda9445c8a8e9f0fdc271330b (127.5.226.66:40399)
I20260811 19:00:13.318766 31613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:33439
Aug 11 19:00:13 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474812, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
I20260811 19:00:13.511917 32580 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:13.512081 32580 heartbeater.cc:511] Master 127.5.226.126:33089 requested a full tablet report, sending...
I20260811 19:00:13.512472 31613 ts_manager.cc:194] Registered new tserver with Master: 9be8d84180e948569f7f26a24ea0654d (127.5.226.67:44053)
I20260811 19:00:13.512986 31613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:54303
I20260811 19:00:13.522336 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 19:00:13.534699 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:13.523328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35788 (local address 127.5.226.126:33089)
0811 19:00:13.523447 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:13.523450 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:13.523579 (+ 129us) server_negotiation.cc:407] Connection header received
0811 19:00:13.523634 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:13.523635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:13.523649 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:13.523725 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:13.524411 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.525150 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.526237 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.526536 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.526602 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:13.531420 (+ 4818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:13.531422 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:13.531422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:13.531431 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:13.533200 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:13.533593 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:13.533594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:13.533595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:13.533651 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:13.533830 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:13.533831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:13.533831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:13.533956 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:13.534035 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:13.534457 (+ 422us) server_negotiation.cc:299] Negotiation successful
0811 19:00:13.534540 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":67,"threads_started":1}
I20260811 19:00:13.538215 31613 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35788:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 19:00:13.540409 31613 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 19:00:13.549067 32648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:13.543456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:40399 (local address 127.0.0.1:36544)
0811 19:00:13.544398 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:13.544440 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:13.544535 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:13.544823 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:13.544826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:13.544828 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:13.544891 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:13.544893 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.546068 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.546069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:13.547590 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:13.547592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.548738 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.548739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:13.548828 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:13.548844 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 19:00:13.548924 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 19:00:13.548977 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":907,"thread_start_us":79,"threads_started":1}
I20260811 19:00:13.549074 32651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:13.543991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36544 (local address 127.5.226.66:40399)
0811 19:00:13.544202 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:13.544208 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:13.544496 (+ 288us) server_negotiation.cc:407] Connection header received
0811 19:00:13.544627 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:13.544629 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:13.544645 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:13.544703 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:13.544957 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.545976 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.547679 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.548634 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.548715 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:13.548778 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:13.548946 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 19:00:13.548988 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":72,"threads_started":1}
I20260811 19:00:13.550295 32154 tablet_service.cc:1467] Processing CreateTablet for tablet d28344c8f9e24c358cf8ff6d8bebdd78 (DEFAULT_TABLE table=test-table [id=0926ff34d7ed4fe281c6b0b604df4bb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:00:13.550724 32154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d28344c8f9e24c358cf8ff6d8bebdd78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:13.554024 32648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:13.543691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:36805 (local address 127.0.0.1:49084)
0811 19:00:13.549851 (+ 6160us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:13.549862 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:13.549905 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:13.550160 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:13.550161 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:13.550163 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:13.550194 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:13.550196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.551522 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.551523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:13.552549 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:13.552553 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.553779 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.553781 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:13.553845 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:13.553850 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 19:00:13.553914 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 19:00:13.553953 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6149,"thread_start_us":73,"threads_started":1}
I20260811 19:00:13.554049 32653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:13.543995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49084 (local address 127.5.226.65:36805)
0811 19:00:13.544272 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:13.544276 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:13.549964 (+ 5688us) server_negotiation.cc:407] Connection header received
0811 19:00:13.550006 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:13.550009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:13.550024 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:13.550092 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:13.550264 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.551432 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.552856 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.553654 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.553751 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:13.553874 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:13.553933 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 19:00:13.553973 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":74,"threads_started":1}
I20260811 19:00:13.554952 32657 tablet_bootstrap.cc:492] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b: Bootstrap starting.
I20260811 19:00:13.555023 31854 tablet_service.cc:1467] Processing CreateTablet for tablet d28344c8f9e24c358cf8ff6d8bebdd78 (DEFAULT_TABLE table=test-table [id=0926ff34d7ed4fe281c6b0b604df4bb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:00:13.555397 31854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d28344c8f9e24c358cf8ff6d8bebdd78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:13.556085 32657 tablet_bootstrap.cc:654] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:13.556401 32657 log.cc:824] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:13.557166 32657 tablet_bootstrap.cc:492] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b: No bootstrap required, opened a new log
I20260811 19:00:13.557226 32657 ts_tablet_manager.cc:1397] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 19:00:13.558362 32646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:13.543475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:44053 (local address 127.0.0.1:39328)
0811 19:00:13.547369 (+ 3894us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:13.547380 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:13.547426 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:13.554708 (+ 7282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:13.554709 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:13.554712 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:13.554751 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:13.554753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.556025 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.556026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:13.557110 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:13.557114 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.558105 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.558107 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:13.558204 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:13.558209 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 19:00:13.558244 (+ 35us) client_negotiation.cc:240] Negotiation successful
0811 19:00:13.558286 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3801,"thread_start_us":89,"threads_started":1}
I20260811 19:00:13.558768 32649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:13.543721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39328 (local address 127.5.226.67:44053)
0811 19:00:13.553969 (+ 10248us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:13.553974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:13.553985 (+ 11us) server_negotiation.cc:407] Connection header received
0811 19:00:13.554020 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:13.554022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:13.554039 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:13.554130 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:13.554847 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.555915 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.557235 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.557998 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.558539 (+ 541us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:13.558614 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:13.558642 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 19:00:13.558684 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10206,"thread_start_us":63,"threads_started":1}
I20260811 19:00:13.559337 32404 tablet_service.cc:1467] Processing CreateTablet for tablet d28344c8f9e24c358cf8ff6d8bebdd78 (DEFAULT_TABLE table=test-table [id=0926ff34d7ed4fe281c6b0b604df4bb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:00:13.559643 32404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d28344c8f9e24c358cf8ff6d8bebdd78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:13.559831 32657 raft_consensus.cc:348] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40399 } } peers { permanent_uuid: "56238ae24b2e4bb7bdba2f41a87d3393" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36805 } } peers { permanent_uuid: "9be8d84180e948569f7f26a24ea0654d" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44053 } }
I20260811 19:00:13.560017 32657 raft_consensus.cc:374] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:13.560053 32657 raft_consensus.cc:729] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c30bbeda9445c8a8e9f0fdc271330b, State: Initialized, Role: FOLLOWER
I20260811 19:00:13.560173 32657 consensus_queue.cc:260] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40399 } } peers { permanent_uuid: "56238ae24b2e4bb7bdba2f41a87d3393" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36805 } } peers { permanent_uuid: "9be8d84180e948569f7f26a24ea0654d" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44053 } }
I20260811 19:00:13.560444 32657 ts_tablet_manager.cc:1428] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 19:00:13.560491 32294 heartbeater.cc:503] Master 127.5.226.126:33089 was elected leader, sending a full tablet report...
I20260811 19:00:13.563012 32661 tablet_bootstrap.cc:492] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d: Bootstrap starting.
I20260811 19:00:13.563905 32661 tablet_bootstrap.cc:654] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:13.564443 32661 log.cc:824] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:13.565259 32661 tablet_bootstrap.cc:492] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d: No bootstrap required, opened a new log
I20260811 19:00:13.565361 32661 ts_tablet_manager.cc:1397] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:00:13.567552 32661 raft_consensus.cc:348] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40399 } } peers { permanent_uuid: "56238ae24b2e4bb7bdba2f41a87d3393" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36805 } } peers { permanent_uuid: "9be8d84180e948569f7f26a24ea0654d" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44053 } }
I20260811 19:00:13.567734 32661 raft_consensus.cc:374] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:13.567775 32661 raft_consensus.cc:729] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9be8d84180e948569f7f26a24ea0654d, State: Initialized, Role: FOLLOWER
I20260811 19:00:13.567888 32661 consensus_queue.cc:260] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40399 } } peers { permanent_uuid: "56238ae24b2e4bb7bdba2f41a87d3393" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36805 } } peers { permanent_uuid: "9be8d84180e948569f7f26a24ea0654d" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44053 } }
I20260811 19:00:13.568149 32661 ts_tablet_manager.cc:1428] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 19:00:13.568195 32580 heartbeater.cc:503] Master 127.5.226.126:33089 was elected leader, sending a full tablet report...
I20260811 19:00:13.569520 32659 tablet_bootstrap.cc:492] T d28344c8f9e24c358cf8ff6d8bebdd78 P 56238ae24b2e4bb7bdba2f41a87d3393: Bootstrap starting.
I20260811 19:00:13.570254 32659 tablet_bootstrap.cc:654] T d28344c8f9e24c358cf8ff6d8bebdd78 P 56238ae24b2e4bb7bdba2f41a87d3393: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:13.570616 32659 log.cc:824] T d28344c8f9e24c358cf8ff6d8bebdd78 P 56238ae24b2e4bb7bdba2f41a87d3393: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:13.578081 32659 tablet_bootstrap.cc:492] T d28344c8f9e24c358cf8ff6d8bebdd78 P 56238ae24b2e4bb7bdba2f41a87d3393: No bootstrap required, opened a new log
I20260811 19:00:13.578186 32659 ts_tablet_manager.cc:1397] T d28344c8f9e24c358cf8ff6d8bebdd78 P 56238ae24b2e4bb7bdba2f41a87d3393: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260811 19:00:13.580591 32659 raft_consensus.cc:348] T d28344c8f9e24c358cf8ff6d8bebdd78 P 56238ae24b2e4bb7bdba2f41a87d3393 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40399 } } peers { permanent_uuid: "56238ae24b2e4bb7bdba2f41a87d3393" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36805 } } peers { permanent_uuid: "9be8d84180e948569f7f26a24ea0654d" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44053 } }
I20260811 19:00:13.580796 32659 raft_consensus.cc:374] T d28344c8f9e24c358cf8ff6d8bebdd78 P 56238ae24b2e4bb7bdba2f41a87d3393 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:13.580829 32659 raft_consensus.cc:729] T d28344c8f9e24c358cf8ff6d8bebdd78 P 56238ae24b2e4bb7bdba2f41a87d3393 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56238ae24b2e4bb7bdba2f41a87d3393, State: Initialized, Role: FOLLOWER
I20260811 19:00:13.580957 32659 consensus_queue.cc:260] T d28344c8f9e24c358cf8ff6d8bebdd78 P 56238ae24b2e4bb7bdba2f41a87d3393 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40399 } } peers { permanent_uuid: "56238ae24b2e4bb7bdba2f41a87d3393" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36805 } } peers { permanent_uuid: "9be8d84180e948569f7f26a24ea0654d" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44053 } }
I20260811 19:00:13.581221 32659 ts_tablet_manager.cc:1428] T d28344c8f9e24c358cf8ff6d8bebdd78 P 56238ae24b2e4bb7bdba2f41a87d3393: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 19:00:13.582125 32024 heartbeater.cc:503] Master 127.5.226.126:33089 was elected leader, sending a full tablet report...
Aug 11 19:00:13 dist-test-slave-gjw7 krb5kdc[29516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474812, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for HTTP/127.5.226.84@KRBTEST.COM
W20260811 19:00:13.606719 32025 tablet.cc:2369] T d28344c8f9e24c358cf8ff6d8bebdd78 P 56238ae24b2e4bb7bdba2f41a87d3393: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:00:13.697330 32660 raft_consensus.cc:482] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:00:13.697505 32660 raft_consensus.cc:504] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40399 } } peers { permanent_uuid: "56238ae24b2e4bb7bdba2f41a87d3393" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36805 } } peers { permanent_uuid: "9be8d84180e948569f7f26a24ea0654d" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44053 } }
I20260811 19:00:13.697960 32660 leader_election.cc:288] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56238ae24b2e4bb7bdba2f41a87d3393 (127.5.226.65:36805), 9be8d84180e948569f7f26a24ea0654d (127.5.226.67:44053)
I20260811 19:00:13.706640 32649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:13.698434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:33635 (local address 127.5.226.67:44053)
0811 19:00:13.698494 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:13.698496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:13.701282 (+ 2786us) server_negotiation.cc:407] Connection header received
0811 19:00:13.701431 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:13.701433 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:13.701444 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:13.701473 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:13.701727 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.702512 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.705674 (+ 3162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.706225 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.706273 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:13.706282 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:13.706518 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 19:00:13.706565 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 19:00:13.706951 32673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:13.698162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:44053 (local address 127.5.226.66:33635)
0811 19:00:13.701176 (+ 3014us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:13.701190 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:13.701337 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:13.701540 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:13.701541 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:13.701543 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:13.701630 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:13.701632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.703950 (+ 2318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.703951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:13.705158 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:13.705162 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.706360 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.706360 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:13.706434 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:13.706439 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 19:00:13.706792 (+ 353us) client_negotiation.cc:240] Negotiation successful
0811 19:00:13.706841 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2990,"thread_start_us":95,"threads_started":1}
I20260811 19:00:13.707401 32463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d28344c8f9e24c358cf8ff6d8bebdd78" candidate_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9be8d84180e948569f7f26a24ea0654d" is_pre_election: true
I20260811 19:00:13.707588 32463 raft_consensus.cc:2454] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c30bbeda9445c8a8e9f0fdc271330b in term 0.
I20260811 19:00:13.707886 32066 leader_election.cc:302] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9be8d84180e948569f7f26a24ea0654d, f6c30bbeda9445c8a8e9f0fdc271330b; no voters:
I20260811 19:00:13.708026 32660 raft_consensus.cc:2781] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 19:00:13.708070 32660 raft_consensus.cc:482] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 19:00:13.708091 32660 raft_consensus.cc:3037] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:13.709070 32660 raft_consensus.cc:504] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40399 } } peers { permanent_uuid: "56238ae24b2e4bb7bdba2f41a87d3393" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36805 } } peers { permanent_uuid: "9be8d84180e948569f7f26a24ea0654d" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44053 } }
I20260811 19:00:13.709223 32660 leader_election.cc:288] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [CANDIDATE]: Term 1 election: Requested vote from peers 56238ae24b2e4bb7bdba2f41a87d3393 (127.5.226.65:36805), 9be8d84180e948569f7f26a24ea0654d (127.5.226.67:44053)
I20260811 19:00:13.709895 32463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d28344c8f9e24c358cf8ff6d8bebdd78" candidate_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9be8d84180e948569f7f26a24ea0654d"
I20260811 19:00:13.710000 32463 raft_consensus.cc:3037] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:13.710868 32463 raft_consensus.cc:2454] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c30bbeda9445c8a8e9f0fdc271330b in term 1.
I20260811 19:00:13.711094 32066 leader_election.cc:302] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9be8d84180e948569f7f26a24ea0654d, f6c30bbeda9445c8a8e9f0fdc271330b; no voters:
I20260811 19:00:13.711169 32660 raft_consensus.cc:2781] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:00:13.711297 32660 raft_consensus.cc:686] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [term 1 LEADER]: Becoming Leader. State: Replica: f6c30bbeda9445c8a8e9f0fdc271330b, State: Running, Role: LEADER
I20260811 19:00:13.711382 32660 consensus_queue.cc:237] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40399 } } peers { permanent_uuid: "56238ae24b2e4bb7bdba2f41a87d3393" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36805 } } peers { permanent_uuid: "9be8d84180e948569f7f26a24ea0654d" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44053 } }
I20260811 19:00:13.711858 32653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:13.698505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:36171 (local address 127.5.226.65:36805)
0811 19:00:13.698551 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:13.698553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:13.707874 (+ 9321us) server_negotiation.cc:407] Connection header received
0811 19:00:13.708057 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:13.708058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:13.708069 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:13.708097 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:13.708371 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.709101 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.710731 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.711335 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.711385 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:13.711393 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:13.711738 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 19:00:13.711787 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 19:00:13.712230 32676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:13.698207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:36805 (local address 127.5.226.66:36171)
0811 19:00:13.706976 (+ 8769us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:13.706990 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:13.707921 (+ 931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:13.708232 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:13.708232 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:13.708235 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:13.708295 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:13.708296 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.709344 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.709345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:13.710611 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:13.710615 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.711552 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.711553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:13.711632 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:13.711635 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:00:13.712105 (+ 470us) client_negotiation.cc:240] Negotiation successful
0811 19:00:13.712148 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8745,"thread_start_us":91,"threads_started":1}
I20260811 19:00:13.712162 31613 catalog_manager.cc:5495] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c30bbeda9445c8a8e9f0fdc271330b (127.5.226.66). New cstate: current_term: 1 leader_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 40399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56238ae24b2e4bb7bdba2f41a87d3393" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9be8d84180e948569f7f26a24ea0654d" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260811 19:00:13.712774 31943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d28344c8f9e24c358cf8ff6d8bebdd78" candidate_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56238ae24b2e4bb7bdba2f41a87d3393"
I20260811 19:00:13.712883 31943 raft_consensus.cc:3037] T d28344c8f9e24c358cf8ff6d8bebdd78 P 56238ae24b2e4bb7bdba2f41a87d3393 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:13.712752 31935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d28344c8f9e24c358cf8ff6d8bebdd78" candidate_uuid: "f6c30bbeda9445c8a8e9f0fdc271330b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56238ae24b2e4bb7bdba2f41a87d3393" is_pre_election: true
I20260811 19:00:13.713763 31943 raft_consensus.cc:2454] T d28344c8f9e24c358cf8ff6d8bebdd78 P 56238ae24b2e4bb7bdba2f41a87d3393 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c30bbeda9445c8a8e9f0fdc271330b in term 1.
W20260811 19:00:13.749737 32584 tablet.cc:2369] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:00:13.753043 32651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:13.749528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36554 (local address 127.5.226.66:40399)
0811 19:00:13.749577 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:13.749579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:13.749590 (+ 11us) server_negotiation.cc:407] Connection header received
0811 19:00:13.749636 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:13.749637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:13.749658 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:13.749732 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:00:13.750001 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.750749 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.751903 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:13.752210 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:13.752271 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:13.752481 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:00:13.752625 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:00:13.752711 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:13.752942 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 19:00:13.752963 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 19:00:13.755398 32463 raft_consensus.cc:1261] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d [term 1 FOLLOWER]: Refusing update from remote peer f6c30bbeda9445c8a8e9f0fdc271330b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:00:13.755709 31943 raft_consensus.cc:1261] T d28344c8f9e24c358cf8ff6d8bebdd78 P 56238ae24b2e4bb7bdba2f41a87d3393 [term 1 FOLLOWER]: Refusing update from remote peer f6c30bbeda9445c8a8e9f0fdc271330b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:00:13.759830 32677 consensus_queue.cc:1035] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56238ae24b2e4bb7bdba2f41a87d3393" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:00:13.760027 32677 consensus_queue.cc:1035] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9be8d84180e948569f7f26a24ea0654d" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:00:13.765959 32681 mvcc.cc:205] Tried to move back new op lower bound from 7317400837138595840 to 7317400836962201600. Current Snapshot: MvccSnapshot[applied={T|T < 7317400837138595840}]
I20260811 19:00:13.767104 32686 mvcc.cc:205] Tried to move back new op lower bound from 7317400837138595840 to 7317400836962201600. Current Snapshot: MvccSnapshot[applied={T|T < 7317400837138595840}]
I20260811 19:00:13.768910 32682 mvcc.cc:205] Tried to move back new op lower bound from 7317400837138595840 to 7317400836962201600. Current Snapshot: MvccSnapshot[applied={T|T < 7317400837138595840}]
I20260811 19:00:13.771471 31613 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35788:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:00:13.771569 31613 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35788:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:00:13.772446 31613 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a77de94a61a14912ae1abac4536bf7cb: Sending DeleteTablet for 3 replicas of tablet d28344c8f9e24c358cf8ff6d8bebdd78
I20260811 19:00:13.772924 32154 tablet_service.cc:1514] Processing DeleteTablet for tablet d28344c8f9e24c358cf8ff6d8bebdd78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:00:13 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:36544
I20260811 19:00:13.773151 32404 tablet_service.cc:1514] Processing DeleteTablet for tablet d28344c8f9e24c358cf8ff6d8bebdd78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:00:13 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:39328
I20260811 19:00:13.773571 31854 tablet_service.cc:1514] Processing DeleteTablet for tablet d28344c8f9e24c358cf8ff6d8bebdd78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:00:13 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:49084
I20260811 19:00:13.774468 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 31701
I20260811 19:00:13.803838 32695 tablet_replica.cc:330] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b: stopping tablet replica
I20260811 19:00:13.804018 32695 raft_consensus.cc:2229] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [term 1 LEADER]: Raft consensus shutting down.
I20260811 19:00:13.804185 32695 raft_consensus.cc:2258] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:00:13.806249 32697 tablet_replica.cc:330] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d: stopping tablet replica
I20260811 19:00:13.806397 32697 raft_consensus.cc:2229] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:00:13.806552 32697 raft_consensus.cc:2258] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:00:13.806977 32695 ts_tablet_manager.cc:1905] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:00:13.807446 32697 ts_tablet_manager.cc:1905] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:00:13.809250 32695 ts_tablet_manager.cc:1918] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:00:13.809363 32695 log.cc:1196] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/d28344c8f9e24c358cf8ff6d8bebdd78
I20260811 19:00:13.809636 32695 ts_tablet_manager.cc:1939] T d28344c8f9e24c358cf8ff6d8bebdd78 P f6c30bbeda9445c8a8e9f0fdc271330b: Deleting consensus metadata
I20260811 19:00:13.810122 31588 catalog_manager.cc:4841] TS f6c30bbeda9445c8a8e9f0fdc271330b (127.5.226.66:40399): tablet d28344c8f9e24c358cf8ff6d8bebdd78 (table test-table [id=0926ff34d7ed4fe281c6b0b604df4bb1]) successfully deleted
I20260811 19:00:13.810789 32697 ts_tablet_manager.cc:1918] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:00:13.810935 32697 log.cc:1196] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/d28344c8f9e24c358cf8ff6d8bebdd78
I20260811 19:00:13.811266 32697 ts_tablet_manager.cc:1939] T d28344c8f9e24c358cf8ff6d8bebdd78 P 9be8d84180e948569f7f26a24ea0654d: Deleting consensus metadata
I20260811 19:00:13.811791 31587 catalog_manager.cc:4841] TS 9be8d84180e948569f7f26a24ea0654d (127.5.226.67:44053): tablet d28344c8f9e24c358cf8ff6d8bebdd78 (table test-table [id=0926ff34d7ed4fe281c6b0b604df4bb1]) successfully deleted
W20260811 19:00:13.815740 31590 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:36805 (error 108)
I20260811 19:00:13.816012 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 32032
I20260811 19:00:13.829254 32646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:13.829070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:36805 (local address 127.0.0.1:49090)
0811 19:00:13.829138 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:13.829205 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:36805: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 19:00:13.829460 31590 catalog_manager.cc:4584] TS 56238ae24b2e4bb7bdba2f41a87d3393 (127.5.226.65:36805): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d28344c8f9e24c358cf8ff6d8bebdd78: Network error: Client connection negotiation failed: client connection to 127.5.226.65:36805: connect: Connection refused (error 111)
I20260811 19:00:13.832393 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 32298
I20260811 19:00:13.877748 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 31549
I20260811 19:00:13.899813 6025 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 19:00:14.247694 6025 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 19:00:14.247798 6025 mini_ranger.cc:66] Stopping Ranger...
I20260811 19:00:14.592973 6025 mini_ranger.cc:68] Stopped Ranger
2026-08-11 19:00:14.593 UTC [29586] LOG: received smart shutdown request
2026-08-11 19:00:14.597 UTC [29586] LOG: background worker "logical replication launcher" (PID 29602) exited with exit code 1
2026-08-11 19:00:14.597 UTC [29595] LOG: shutting down
2026-08-11 19:00:14.735 UTC [29586] LOG: database system is shut down
2026-08-11T19:00:14Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47285 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:00:14 dist-test-slave-gjw7 krb5kdc[32720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:00:14 dist-test-slave-gjw7 krb5kdc[32720](info): set up 2 sockets
Aug 11 19:00:14 dist-test-slave-gjw7 krb5kdc[32720](info): commencing operation
krb5kdc: starting...
W20260811 19:00:16.044536 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:00:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:00:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:00:16.167450 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:46283
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:34405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:46283,127.5.226.125:40645,127.5.226.124:43445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:16.249372 32751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:16.249585 32751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:16.249616 32751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:16.250752 32751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:00:16.250799 32751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:16.250818 32751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:16.250834 32751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:00:16.250860 32751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:00:16.252573 32751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:46283,127.5.226.125:40645,127.5.226.124:43445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:46283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:16.252869 32751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:16.253140 32751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:16.257989 300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:16.257990 32764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:16.258047 32751 server_base.cc:1034] running on GCE node
W20260811 19:00:16.257989 32763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:16.258468 32751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:16.258754 32751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:16.259899 32751 hybrid_clock.cc:648] HybridClock initialized: now 1786474816259887 us; error 28 us; skew 500 ppm
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:16.267125 32751 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:00:16.267639 32751 webserver.cc:460] Webserver started at http://127.5.226.126:43195/ using document root <none> and password file <none>
I20260811 19:00:16.267855 32751 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:16.267902 32751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:16.268045 32751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:16.269160 32751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "90565f46113a4e468bc56b63bbb023ed"
format_stamp: "Formatted at 2026-08-11 19:00:16 on dist-test-slave-gjw7"
server_key: "514830813e3f2e133d77c150b31db4f3"
server_key_iv: "d95a238a20adacbc9ca3bc57efefb852"
server_key_version: "encryptionkey@0"
I20260811 19:00:16.269579 32751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "90565f46113a4e468bc56b63bbb023ed"
format_stamp: "Formatted at 2026-08-11 19:00:16 on dist-test-slave-gjw7"
server_key: "514830813e3f2e133d77c150b31db4f3"
server_key_iv: "d95a238a20adacbc9ca3bc57efefb852"
server_key_version: "encryptionkey@0"
I20260811 19:00:16.270889 32751 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:00:16.271605 310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:16.271775 32751 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:00:16.271860 32751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "90565f46113a4e468bc56b63bbb023ed"
format_stamp: "Formatted at 2026-08-11 19:00:16 on dist-test-slave-gjw7"
server_key: "514830813e3f2e133d77c150b31db4f3"
server_key_iv: "d95a238a20adacbc9ca3bc57efefb852"
server_key_version: "encryptionkey@0"
I20260811 19:00:16.271935 32751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:16.279767 32751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:16.281441 32751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:16.281562 32751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:16.285429 32751 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:46283
I20260811 19:00:16.285487 405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:46283 every 8 connection(s)
I20260811 19:00:16.285777 32751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:00:16.286605 407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:16.288096 407 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:00:16.292582 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 32751
I20260811 19:00:16.292691 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:00:16.292860 6025 external_mini_cluster.cc:1428] Setting key 7b621aab14150439175deb7a99379ed9
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:16.296991 413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.288738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33320 (local address 127.5.226.126:46283)
0811 19:00:16.288956 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.288960 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.288983 (+ 23us) server_negotiation.cc:407] Connection header received
0811 19:00:16.289531 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.289532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.289550 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.289622 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.290106 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.290881 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.291667 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.291990 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.292062 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.294192 (+ 2130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.294201 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.294202 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.294209 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.295599 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.296020 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.296022 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.296023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.296094 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.296308 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.296308 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.296308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.296487 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.296543 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.296740 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.296835 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":80,"threads_started":1}
I20260811 19:00:16.297055 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.288702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:46283 (local address 127.0.0.1:33320)
0811 19:00:16.288885 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.288917 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:16.289398 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:16.289635 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:16.289637 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:16.289886 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:16.290039 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.290043 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.290947 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.290948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.291606 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.291608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.292046 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.292047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.292096 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.292557 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:16.292565 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:16.294109 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:16.295680 (+ 1571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.295688 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.295690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.295948 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.296147 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.296148 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.296148 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.296254 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.296545 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:16.296552 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:16.296626 (+ 74us) client_negotiation.cc:769] Sending connection context
0811 19:00:16.296714 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 19:00:16.296928 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":62,"thread_start_us":101,"threads_started":1}
I20260811 19:00:16.297833 407 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:00:16.298156 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.298044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:40645 (local address 127.0.0.1:44248)
0811 19:00:16.298088 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.298134 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:40645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 19:00:16.298286 315 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.226.125:40645: connect: Connection refused (error 111)
I20260811 19:00:16.298689 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.298595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:40645 (local address 127.0.0.1:44252)
0811 19:00:16.298637 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.298667 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:40645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 19:00:16.298799 407 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.125:40645: Network error: Client connection negotiation failed: client connection to 127.5.226.125:40645: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.5.226.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.125.keytab.
Entry for principal kudu/127.5.226.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.125.keytab.
I20260811 19:00:16.317876 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.125:40645
--webserver_interface=127.5.226.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.125.keytab
--principal=kudu/127.5.226.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:34405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:46283,127.5.226.125:40645,127.5.226.124:43445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:00:16.348052 407 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } attempt: 1
I20260811 19:00:16.348711 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.348538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:40645 (local address 127.0.0.1:44258)
0811 19:00:16.348618 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.348673 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:40645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 19:00:16.349108 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.349008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:40645 (local address 127.0.0.1:44264)
0811 19:00:16.349059 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.349088 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:40645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 19:00:16.349246 407 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.125:40645: Network error: Client connection negotiation failed: client connection to 127.5.226.125:40645: connect: Connection refused (error 111)
W20260811 19:00:16.402716 425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:16.402945 425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:16.402976 425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:16.404161 425 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:00:16.404215 425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:16.404234 425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:16.404250 425 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:00:16.404264 425 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:00:16.406064 425 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:46283,127.5.226.125:40645,127.5.226.124:43445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.125.keytab
--principal=kudu/127.5.226.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.125:40645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.226.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:16.406368 425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:16.406595 425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:16.411434 440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:16.411576 425 server_base.cc:1034] running on GCE node
W20260811 19:00:16.411473 441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:16.411556 444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:16.411954 425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:16.412259 425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:16.413393 425 hybrid_clock.cc:648] HybridClock initialized: now 1786474816413375 us; error 34 us; skew 500 ppm
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:16.415809 425 init.cc:377] Logged in from keytab as kudu/127.5.226.125@KRBTEST.COM (short username kudu)
I20260811 19:00:16.416256 425 webserver.cc:460] Webserver started at http://127.5.226.125:37845/ using document root <none> and password file <none>
I20260811 19:00:16.416455 425 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:16.416497 425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:16.416625 425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:16.417411 407 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } attempt: 2
I20260811 19:00:16.417781 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.417638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:40645 (local address 127.0.0.1:44268)
0811 19:00:16.417702 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.417742 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:40645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 19:00:16.417784 425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/data/instance:
uuid: "30e43466a9cd46ab9dae0cd721b621b4"
format_stamp: "Formatted at 2026-08-11 19:00:16 on dist-test-slave-gjw7"
server_key: "e192a82b259950448efada4bdc44f81d"
server_key_iv: "9f3f7bbb5efe724cdf7be040a7d63ca2"
server_key_version: "encryptionkey@0"
I20260811 19:00:16.418138 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.418020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:40645 (local address 127.0.0.1:44270)
0811 19:00:16.418081 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.418113 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:40645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 19:00:16.418190 425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/wal/instance:
uuid: "30e43466a9cd46ab9dae0cd721b621b4"
format_stamp: "Formatted at 2026-08-11 19:00:16 on dist-test-slave-gjw7"
server_key: "e192a82b259950448efada4bdc44f81d"
server_key_iv: "9f3f7bbb5efe724cdf7be040a7d63ca2"
server_key_version: "encryptionkey@0"
W20260811 19:00:16.418275 407 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.125:40645: Network error: Client connection negotiation failed: client connection to 127.5.226.125:40645: connect: Connection refused (error 111)
I20260811 19:00:16.419472 425 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:00:16.420125 463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:16.420285 425 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:00:16.420367 425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/wal
uuid: "30e43466a9cd46ab9dae0cd721b621b4"
format_stamp: "Formatted at 2026-08-11 19:00:16 on dist-test-slave-gjw7"
server_key: "e192a82b259950448efada4bdc44f81d"
server_key_iv: "9f3f7bbb5efe724cdf7be040a7d63ca2"
server_key_version: "encryptionkey@0"
I20260811 19:00:16.420440 425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:16.443130 425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:16.445067 425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:16.445199 425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:16.449087 425 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.125:40645
I20260811 19:00:16.449137 575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.125:40645 every 8 connection(s)
I20260811 19:00:16.449469 425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/data/info.pb
I20260811 19:00:16.450338 576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:16.451934 576 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:00:16.453429 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 425
I20260811 19:00:16.453545 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-1/wal/instance
I20260811 19:00:16.453750 6025 external_mini_cluster.cc:1428] Setting key cbb882010fb37a6ea4d0f061f66ed237
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.125@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:16.460973 413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.452613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33324 (local address 127.5.226.126:46283)
0811 19:00:16.452699 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.452701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.452852 (+ 151us) server_negotiation.cc:407] Connection header received
0811 19:00:16.453406 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.453408 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.453426 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.453498 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.454192 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.454846 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.455931 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.456226 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.456296 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.458505 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.458507 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.458507 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.458515 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.459750 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.460106 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.460108 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.460108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.460161 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.460379 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.460380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.460381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.460487 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.460542 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.460799 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.460884 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 19:00:16.461134 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.452576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:46283 (local address 127.0.0.1:33324)
0811 19:00:16.452738 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.452776 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:16.453233 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:16.453580 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:16.453585 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:16.453886 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:16.454097 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.454102 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.454949 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.454951 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.455843 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.455846 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.456301 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.456302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.456400 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.456912 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:16.456922 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:16.458418 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:16.459825 (+ 1407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.459832 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.459835 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.460042 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.460222 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.460222 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.460223 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.460324 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.460540 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:16.460547 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:16.460684 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 19:00:16.460770 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 19:00:16.460924 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":76,"threads_started":1}
I20260811 19:00:16.461643 576 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.5.226.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.124@KRBTEST.COM" created.
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.125@KRBTEST.COM for kudu/127.5.226.125@KRBTEST.COM
I20260811 19:00:16.468583 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.461886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:40645 (local address 127.0.0.1:44278)
0811 19:00:16.461937 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.461948 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:16.461994 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:16.462212 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:16.462213 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:16.462349 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:16.462402 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.462404 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.463250 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.463251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.463733 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.463735 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.464237 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.464237 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.464287 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.464648 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:16.464653 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:16.465898 (+ 1245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:16.467582 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.467582 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.467583 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.467747 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.467952 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.467953 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.467953 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.468002 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.468319 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:16.468320 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:16.468363 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 19:00:16.468430 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 19:00:16.468517 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 19:00:16.468708 583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.461924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44278 (local address 127.5.226.125:40645)
0811 19:00:16.462065 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.462070 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.462089 (+ 19us) server_negotiation.cc:407] Connection header received
0811 19:00:16.462110 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.462112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.462125 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.462187 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.462458 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.463156 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.463798 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.464148 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.464234 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.465969 (+ 1735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.465977 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.465978 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.465984 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.467505 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.467822 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.467825 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.467826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.467892 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.468049 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.468050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.468050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.468226 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.468310 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.468473 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.468597 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":114,"thread_start_us":78,"threads_started":1}
I20260811 19:00:16.469259 576 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:00:16.469602 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.469504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:43445 (local address 127.0.0.1:42884)
0811 19:00:16.469538 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.469583 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260811 19:00:16.469749 464 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
I20260811 19:00:16.470144 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.470065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:43445 (local address 127.0.0.1:42886)
0811 19:00:16.470103 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.470128 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 19:00:16.470249 576 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:43445: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.124.keytab.
Entry for principal kudu/127.5.226.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.124.keytab.
I20260811 19:00:16.480340 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.124:43445
--webserver_interface=127.5.226.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.124.keytab
--principal=kudu/127.5.226.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:34405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:46283,127.5.226.125:40645,127.5.226.124:43445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:00:16.509423 407 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } attempt: 3
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for kudu/127.5.226.125@KRBTEST.COM
I20260811 19:00:16.515928 583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.509863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44288 (local address 127.5.226.125:40645)
0811 19:00:16.509922 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.509924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.509934 (+ 10us) server_negotiation.cc:407] Connection header received
0811 19:00:16.509967 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.509968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.509980 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.510026 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.510350 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.510855 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.511540 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.511743 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.511802 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.513631 (+ 1829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.513633 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.513633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.513642 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.514908 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.515211 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.515212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.515212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.515273 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.515431 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.515432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.515432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.515539 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.515594 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.515726 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.515812 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 19:00:16.515928 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.509792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:40645 (local address 127.0.0.1:44288)
0811 19:00:16.509859 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.509868 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:16.509915 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:16.510038 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:16.510039 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:16.510206 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:16.510276 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.510278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.510934 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.510935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.511458 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.511461 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.511808 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.511809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.511880 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.512318 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:16.512323 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:16.513546 (+ 1223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:16.514986 (+ 1440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.514988 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.514988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.515150 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.515328 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.515329 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.515329 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.515383 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.515593 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:16.515594 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:16.515641 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 19:00:16.515700 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 19:00:16.515808 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 19:00:16.516363 407 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:00:16.516712 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.516622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:43445 (local address 127.0.0.1:42888)
0811 19:00:16.516665 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.516693 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 19:00:16.517030 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.516954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:43445 (local address 127.0.0.1:42894)
0811 19:00:16.516986 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.517008 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 19:00:16.517113 407 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:43445: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
I20260811 19:00:16.519445 576 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } attempt: 1
I20260811 19:00:16.519801 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.519666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:43445 (local address 127.0.0.1:42904)
0811 19:00:16.519722 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.519765 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 19:00:16.520082 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.520014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:43445 (local address 127.0.0.1:42914)
0811 19:00:16.520039 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.520064 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260811 19:00:16.520171 576 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:43445: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
I20260811 19:00:16.548259 407 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } attempt: 1
I20260811 19:00:16.548821 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.548666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:43445 (local address 127.0.0.1:42926)
0811 19:00:16.548747 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.548791 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 19:00:16.549146 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.549064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:43445 (local address 127.0.0.1:42930)
0811 19:00:16.549103 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.549127 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 19:00:16.549242 407 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:43445: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
W20260811 19:00:16.566344 595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:16.566543 595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:16.566565 595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:16.567657 595 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:00:16.567693 595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:16.567706 595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:16.567718 595 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:00:16.567728 595 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:00:16.569160 595 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:46283,127.5.226.125:40645,127.5.226.124:43445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.124.keytab
--principal=kudu/127.5.226.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.124:43445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.226.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:16.569396 595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:16.569569 595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:16.573972 615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:16.573973 606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:16.573972 610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:16.574240 595 server_base.cc:1034] running on GCE node
I20260811 19:00:16.574493 595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:16.574762 595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:16.575924 595 hybrid_clock.cc:648] HybridClock initialized: now 1786474816575911 us; error 31 us; skew 500 ppm
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:16.578354 595 init.cc:377] Logged in from keytab as kudu/127.5.226.124@KRBTEST.COM (short username kudu)
I20260811 19:00:16.578742 595 webserver.cc:460] Webserver started at http://127.5.226.124:45423/ using document root <none> and password file <none>
I20260811 19:00:16.578954 595 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:16.579003 595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:16.579126 595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:16.580163 595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/data/instance:
uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac"
format_stamp: "Formatted at 2026-08-11 19:00:16 on dist-test-slave-gjw7"
server_key: "7331d2e35f1bf79c5d5710550becd26b"
server_key_iv: "072402a5629ada9e04693c4c19f35137"
server_key_version: "encryptionkey@0"
I20260811 19:00:16.580499 595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/wal/instance:
uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac"
format_stamp: "Formatted at 2026-08-11 19:00:16 on dist-test-slave-gjw7"
server_key: "7331d2e35f1bf79c5d5710550becd26b"
server_key_iv: "072402a5629ada9e04693c4c19f35137"
server_key_version: "encryptionkey@0"
I20260811 19:00:16.581868 595 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 19:00:16.582545 627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:16.582696 595 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:16.582834 595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/wal
uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac"
format_stamp: "Formatted at 2026-08-11 19:00:16 on dist-test-slave-gjw7"
server_key: "7331d2e35f1bf79c5d5710550becd26b"
server_key_iv: "072402a5629ada9e04693c4c19f35137"
server_key_version: "encryptionkey@0"
I20260811 19:00:16.582897 595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:16.588315 576 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } attempt: 2
I20260811 19:00:16.588662 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.588549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:43445 (local address 127.0.0.1:42944)
0811 19:00:16.588604 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.588632 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 19:00:16.588965 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.588885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:43445 (local address 127.0.0.1:42950)
0811 19:00:16.588919 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.588942 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 19:00:16.589040 576 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:43445: Network error: Client connection negotiation failed: client connection to 127.5.226.124:43445: connect: Connection refused (error 111)
I20260811 19:00:16.595212 595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:16.597078 595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:16.597213 595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:16.600934 595 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.124:43445
I20260811 19:00:16.600978 750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.124:43445 every 8 connection(s)
I20260811 19:00:16.601313 595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/data/info.pb
I20260811 19:00:16.602169 751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:16.603729 751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:00:16.608530 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 595
I20260811 19:00:16.608635 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474660766540-6025-0/minicluster-data/master-2/wal/instance
I20260811 19:00:16.608798 6025 external_mini_cluster.cc:1428] Setting key 591bf8c97531ddb6777d3a7f21c6f841
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.124@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:16.612291 413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.604400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33328 (local address 127.5.226.126:46283)
0811 19:00:16.604478 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.604481 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.604697 (+ 216us) server_negotiation.cc:407] Connection header received
0811 19:00:16.605181 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.605182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.605192 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.605231 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.605905 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.606390 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.607367 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.607546 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.607588 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.609757 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.609759 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.609759 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.609766 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.611017 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.611411 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.611413 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.611413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.611480 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.611685 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.611686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.611686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.611815 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.611884 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.612147 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.612227 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 19:00:16.612490 755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.604371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:46283 (local address 127.0.0.1:33328)
0811 19:00:16.604564 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.604604 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:16.605082 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:16.605312 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:16.605317 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:16.605600 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:16.605819 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.605825 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.606490 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.606492 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.607289 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.607292 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.607599 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.607599 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.607712 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.608170 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:16.608178 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:16.609672 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:16.611095 (+ 1423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.611102 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.611104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.611332 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.611544 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.611545 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.611545 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.611636 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.611871 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:16.611875 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:16.612021 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 19:00:16.612127 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 19:00:16.612272 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":77,"threads_started":1}
I20260811 19:00:16.613317 751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.124@KRBTEST.COM
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.124@KRBTEST.COM for kudu/127.5.226.125@KRBTEST.COM
I20260811 19:00:16.617777 757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.609158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42958 (local address 127.5.226.124:43445)
0811 19:00:16.609325 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.609329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.609351 (+ 22us) server_negotiation.cc:407] Connection header received
0811 19:00:16.609750 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.609752 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.609763 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.609822 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.610401 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.611064 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.611898 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.612324 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.612389 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.614887 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.614896 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.614896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.614903 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.616575 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.616939 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.616941 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.616941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.616996 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.617178 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.617178 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.617179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.617351 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.617496 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.617581 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.617650 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":73,"threads_started":1}
I20260811 19:00:16.619719 755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.613555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:40645 (local address 127.0.0.1:44298)
0811 19:00:16.613595 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.613606 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:16.613641 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:16.613820 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:16.613821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:16.613952 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:16.614014 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.614016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.614637 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.614638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.615284 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.615287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.615671 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.615673 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.615735 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.615988 (+ 253us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:16.615993 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:16.617318 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:16.618838 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.618839 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.618840 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.619037 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.619214 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.619215 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.619215 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.619280 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.619522 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:16.619522 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:16.619553 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 19:00:16.619596 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 19:00:16.619661 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 19:00:16.619786 583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.613638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44298 (local address 127.5.226.125:40645)
0811 19:00:16.613684 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.613685 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.613694 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:00:16.613720 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.613721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.613731 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.613819 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.614090 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.614568 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.615365 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.615598 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.615664 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.617384 (+ 1720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.617385 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.617385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.617392 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.618749 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.619101 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.619102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.619102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.619156 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.619333 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.619334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.619334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.619463 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.619529 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.619621 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.619697 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 19:00:16.620167 751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.124@KRBTEST.COM for kudu/127.5.226.124@KRBTEST.COM
I20260811 19:00:16.624418 407 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } attempt: 2
I20260811 19:00:16.626458 755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.620467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:43445 (local address 127.0.0.1:42962)
0811 19:00:16.620510 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.620520 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:16.620556 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:16.620673 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:16.620674 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:16.620782 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:16.620818 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.620819 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.621551 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.621552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.621997 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.621999 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.622428 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.622429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.622476 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.622839 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:16.622844 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:16.623916 (+ 1072us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:16.625622 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.625623 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.625623 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.625798 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.625961 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.625962 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.625963 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.626010 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.626210 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:16.626211 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:16.626248 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 19:00:16.626289 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 19:00:16.626371 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 19:00:16.626480 413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.618534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33344 (local address 127.5.226.126:46283)
0811 19:00:16.618575 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.618577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.618633 (+ 56us) server_negotiation.cc:407] Connection header received
0811 19:00:16.618706 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.618707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.618716 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.618757 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.619261 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.619923 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.620820 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.621048 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.621095 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.623558 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.623560 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.623560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.623568 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.625378 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.625726 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.625727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.625727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.625806 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.625991 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.625992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.625993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.626118 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.626288 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.626324 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.626394 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 19:00:16.626739 757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.620499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42962 (local address 127.5.226.124:43445)
0811 19:00:16.620534 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.620536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.620546 (+ 10us) server_negotiation.cc:407] Connection header received
0811 19:00:16.620600 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.620601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.620610 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.620670 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.620880 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.621459 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.622067 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.622360 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.622419 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.624018 (+ 1599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.624020 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.624020 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.624027 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.625544 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.625852 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.625853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.625853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.625900 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.626064 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.626065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.626065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.626143 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.626560 (+ 417us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.626605 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.626673 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 19:00:16.628561 751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac: Bootstrap starting.
I20260811 19:00:16.629310 751 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:16.629624 751 log.cc:824] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:16.630398 751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac: No bootstrap required, opened a new log
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for kudu/127.5.226.124@KRBTEST.COM
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.125@KRBTEST.COM
I20260811 19:00:16.632445 751 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } }
I20260811 19:00:16.632591 751 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:16.632616 751 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ddfd65793b4ff9a5c64d55fee9a2ac, State: Initialized, Role: FOLLOWER
I20260811 19:00:16.632715 751 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } }
I20260811 19:00:16.633051 751 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:00:16.633250 768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } } }
I20260811 19:00:16.633370 768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:00:16.634805 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.624636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:43445 (local address 127.0.0.1:42968)
0811 19:00:16.624680 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.624691 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:16.624728 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:16.625026 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:16.625028 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:16.625229 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:16.625272 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.625274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.626727 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.626729 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.627423 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.627426 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.629789 (+ 2363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.629790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.629849 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.630218 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:16.630223 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:16.631304 (+ 1081us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:16.633668 (+ 2364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.633669 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.633670 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.633884 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.634113 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.634115 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.634115 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.634184 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.634526 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:16.634527 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:16.634569 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 19:00:16.634626 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 19:00:16.634712 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 19:00:16.635102 790 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:00:16.635196 790 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:00:16.635489 760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.624695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42968 (local address 127.5.226.124:43445)
0811 19:00:16.624894 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.624895 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.624903 (+ 8us) server_negotiation.cc:407] Connection header received
0811 19:00:16.624921 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.624922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.624931 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.624996 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.625392 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.626536 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.629382 (+ 2846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.629680 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.629763 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.631379 (+ 1616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.631380 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.631381 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.631388 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.633526 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.633965 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.633966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.633967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.634029 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.634255 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.634256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.634256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.634436 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.634498 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.635167 (+ 669us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.635244 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":134,"threads_started":1}
I20260811 19:00:16.635536 583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.627527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44300 (local address 127.5.226.125:40645)
0811 19:00:16.627562 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.627564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.627571 (+ 7us) server_negotiation.cc:407] Connection header received
0811 19:00:16.627593 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.627594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.627602 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.627640 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.628135 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.628578 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.629442 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.629714 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.629768 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.632242 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.632244 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.632244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.632251 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.633949 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.634308 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.634309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.634310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.634371 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.634643 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.634644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.634644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.634784 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.634970 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.635373 (+ 403us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.635459 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 19:00:16.636866 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:00:16.636961 407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed: Bootstrap starting.
I20260811 19:00:16.637754 407 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:16.635521 595 master_runner.cc:186] Error getting master registration for 127.5.226.126:46283: OK, instance_id { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" instance_seqno: 1786474816284340 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 19:00:16.637859 595 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 19:00:16.638090 407 log.cc:824] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:16.638926 407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed: No bootstrap required, opened a new log
I20260811 19:00:16.640988 407 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } }
I20260811 19:00:16.641120 407 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:16.641155 407 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90565f46113a4e468bc56b63bbb023ed, State: Initialized, Role: FOLLOWER
I20260811 19:00:16.641274 407 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } }
I20260811 19:00:16.641613 407 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [sys.catalog]: configured and running, proceeding with master startup.
W20260811 19:00:16.643687 833 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:00:16.643807 833 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:00:16.644255 32751 master_runner.cc:186] Error getting master registration for 127.5.226.125:40645: OK, instance_id { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" instance_seqno: 1786474816448007 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 19:00:16.648602 32751 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 19:00:16.650004 413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.638362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33352 (local address 127.5.226.126:46283)
0811 19:00:16.638401 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.638402 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.638576 (+ 174us) server_negotiation.cc:407] Connection header received
0811 19:00:16.638681 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.638682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.638694 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.638726 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.639348 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.639806 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.640494 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.640702 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.640762 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.642270 (+ 1508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.642271 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.642272 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.642280 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.648434 (+ 6154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.649028 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.649029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.649030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.649092 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.649385 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.649386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.649387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.649527 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.649602 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.649831 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.649915 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 19:00:16.650064 583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.638614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44310 (local address 127.5.226.125:40645)
0811 19:00:16.638660 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.638662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.641502 (+ 2840us) server_negotiation.cc:407] Connection header received
0811 19:00:16.641609 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.641610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.641622 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.641668 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.642315 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.643440 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.644332 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.644596 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.644637 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.646231 (+ 1594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.646233 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.646233 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.646240 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.647886 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.648365 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.648366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.648366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.648498 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.648840 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.648841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.648841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.648973 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.649604 (+ 631us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.649909 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.649980 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 19:00:16.653398 809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } } }
I20260811 19:00:16.653503 809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:00:16.656617 760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.645538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42972 (local address 127.5.226.124:43445)
0811 19:00:16.645575 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.645577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.650595 (+ 5018us) server_negotiation.cc:407] Connection header received
0811 19:00:16.650720 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.650721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.650750 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.650783 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.651403 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.651881 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.652513 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.652745 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.652806 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.654047 (+ 1241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.654048 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.654049 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.654057 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.655454 (+ 1397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.655785 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.655787 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.655787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.655848 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.656066 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.656067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.656067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.656193 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.656286 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.656437 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.656516 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 19:00:16.680225 576 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } attempt: 3
Aug 11 19:00:16 dist-test-slave-gjw7 krb5kdc[32720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474816, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.125@KRBTEST.COM for kudu/127.5.226.124@KRBTEST.COM
I20260811 19:00:16.688912 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.680515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:43445 (local address 127.0.0.1:42980)
0811 19:00:16.680566 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:16.680577 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:16.680616 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:16.680816 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:16.680817 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:16.681012 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:16.681066 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.681068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.682035 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.682037 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.682840 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:16.682843 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.683308 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.683309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:16.683366 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.683854 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:16.683859 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:16.685449 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:16.687851 (+ 2402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.687852 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.687853 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.688073 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.688290 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:16.688291 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:16.688291 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:16.688358 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:16.688597 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:16.688598 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:16.688646 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 19:00:16.688714 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 19:00:16.688809 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 19:00:16.688913 760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:16.680586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42980 (local address 127.5.226.124:43445)
0811 19:00:16.680685 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:16.680687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:16.680694 (+ 7us) server_negotiation.cc:407] Connection header received
0811 19:00:16.680715 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:16.680716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:16.680725 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:16.680776 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:16.681146 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.681946 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.682927 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:16.683234 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:16.683301 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:16.685536 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:16.685538 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:16.685538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:16.685545 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:16.687771 (+ 2226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.688145 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.688146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.688147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.688217 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:16.688414 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:16.688415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:16.688415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:16.688540 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:16.688602 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:16.688744 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 19:00:16.688821 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 19:00:16.691102 576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4: Bootstrap starting.
I20260811 19:00:16.691854 576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:16.692165 576 log.cc:824] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:16.693053 576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4: No bootstrap required, opened a new log
I20260811 19:00:16.695075 576 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } }
I20260811 19:00:16.695216 576 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:16.695250 576 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30e43466a9cd46ab9dae0cd721b621b4, State: Initialized, Role: FOLLOWER
I20260811 19:00:16.695375 576 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } }
I20260811 19:00:16.695684 576 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:00:16.695642 845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } } }
W20260811 19:00:16.695837 471 tablet.cc:2369] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:00:16.696105 845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 19:00:16.697867 864 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:00:16.697921 864 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:00:16.699990 425 master_runner.cc:263] No leader master found from master 30e43466a9cd46ab9dae0cd721b621b4
I20260811 19:00:16.700043 425 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 19:00:16.782298 319 tablet.cc:2369] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:00:16.804544 845 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:00:16.804674 845 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } }
I20260811 19:00:16.804949 845 leader_election.cc:288] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90565f46113a4e468bc56b63bbb023ed (127.5.226.126:46283), 90ddfd65793b4ff9a5c64d55fee9a2ac (127.5.226.124:43445)
I20260811 19:00:16.805325 359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "30e43466a9cd46ab9dae0cd721b621b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90565f46113a4e468bc56b63bbb023ed" is_pre_election: true
I20260811 19:00:16.805480 359 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30e43466a9cd46ab9dae0cd721b621b4 in term 0.
I20260811 19:00:16.805675 706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "30e43466a9cd46ab9dae0cd721b621b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" is_pre_election: true
I20260811 19:00:16.805815 706 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30e43466a9cd46ab9dae0cd721b621b4 in term 0.
I20260811 19:00:16.806030 464 leader_election.cc:302] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30e43466a9cd46ab9dae0cd721b621b4, 90ddfd65793b4ff9a5c64d55fee9a2ac; no voters:
I20260811 19:00:16.806221 845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 19:00:16.806270 845 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 19:00:16.806293 845 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:16.807025 845 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } }
I20260811 19:00:16.807147 845 leader_election.cc:288] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [CANDIDATE]: Term 1 election: Requested vote from peers 90565f46113a4e468bc56b63bbb023ed (127.5.226.126:46283), 90ddfd65793b4ff9a5c64d55fee9a2ac (127.5.226.124:43445)
I20260811 19:00:16.807364 706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "30e43466a9cd46ab9dae0cd721b621b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac"
I20260811 19:00:16.807364 359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "30e43466a9cd46ab9dae0cd721b621b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90565f46113a4e468bc56b63bbb023ed"
I20260811 19:00:16.807441 359 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:16.807441 706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:16.808223 359 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30e43466a9cd46ab9dae0cd721b621b4 in term 1.
I20260811 19:00:16.808231 706 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30e43466a9cd46ab9dae0cd721b621b4 in term 1.
I20260811 19:00:16.808384 464 leader_election.cc:302] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30e43466a9cd46ab9dae0cd721b621b4, 90ddfd65793b4ff9a5c64d55fee9a2ac; no voters:
I20260811 19:00:16.808459 845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:00:16.808619 845 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [term 1 LEADER]: Becoming Leader. State: Replica: 30e43466a9cd46ab9dae0cd721b621b4, State: Running, Role: LEADER
I20260811 19:00:16.808727 845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } }
I20260811 19:00:16.809098 845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30e43466a9cd46ab9dae0cd721b621b4. Latest consensus state: current_term: 1 leader_uuid: "30e43466a9cd46ab9dae0cd721b621b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } } }
I20260811 19:00:16.809178 845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:16.809528 868 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:00:16.809796 868 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:00:16.811146 706 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [term 1 FOLLOWER]: Refusing update from remote peer 30e43466a9cd46ab9dae0cd721b621b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:00:16.811219 359 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [term 1 FOLLOWER]: Refusing update from remote peer 30e43466a9cd46ab9dae0cd721b621b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:00:16.811470 845 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:00:16.811719 866 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:00:16.812551 809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30e43466a9cd46ab9dae0cd721b621b4. Latest consensus state: current_term: 1 leader_uuid: "30e43466a9cd46ab9dae0cd721b621b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } } }
I20260811 19:00:16.812623 809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:00:16.813796 768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30e43466a9cd46ab9dae0cd721b621b4. Latest consensus state: current_term: 1 leader_uuid: "30e43466a9cd46ab9dae0cd721b621b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } } }
I20260811 19:00:16.813875 768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:00:16.814186 866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "30e43466a9cd46ab9dae0cd721b621b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } } }
I20260811 19:00:16.814276 866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:16.814340 874 mvcc.cc:205] Tried to move back new op lower bound from 7317400849656524800 to 7317400849648984064. Current Snapshot: MvccSnapshot[applied={T|T < 7317400849656524800}]
I20260811 19:00:16.814414 809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "30e43466a9cd46ab9dae0cd721b621b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } } }
I20260811 19:00:16.814471 809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:00:16.814731 878 mvcc.cc:205] Tried to move back new op lower bound from 7317400849656524800 to 7317400849648984064. Current Snapshot: MvccSnapshot[applied={T|T < 7317400849656524800}]
I20260811 19:00:16.815393 868 catalog_manager.cc:1347] Generated new cluster ID: cc1bc67ffbbc4ca4baa4ffdae0d9f5d2
I20260811 19:00:16.815438 868 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:00:16.821543 845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "30e43466a9cd46ab9dae0cd721b621b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } } }
I20260811 19:00:16.821641 845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4 [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:16.822079 768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "30e43466a9cd46ab9dae0cd721b621b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90565f46113a4e468bc56b63bbb023ed" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 46283 } } peers { permanent_uuid: "30e43466a9cd46ab9dae0cd721b621b4" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 40645 } } peers { permanent_uuid: "90ddfd65793b4ff9a5c64d55fee9a2ac" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 43445 } } }
I20260811 19:00:16.822168 768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:00:16.828251 868 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:00:16.828797 868 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:00:16.832448 868 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30e43466a9cd46ab9dae0cd721b621b4: Generated new TSK 0
I20260811 19:00:16.832666 868 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:00:17.635731 790 catalog_manager.cc:1259] Loaded cluster ID: cc1bc67ffbbc4ca4baa4ffdae0d9f5d2
I20260811 19:00:17.635821 790 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac: loading cluster ID for follower catalog manager: success
I20260811 19:00:17.636713 790 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac: acquiring CA information for follower catalog manager: success
I20260811 19:00:17.637046 790 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 90ddfd65793b4ff9a5c64d55fee9a2ac: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 19:00:17.644244 833 catalog_manager.cc:1259] Loaded cluster ID: cc1bc67ffbbc4ca4baa4ffdae0d9f5d2
I20260811 19:00:17.644306 833 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed: loading cluster ID for follower catalog manager: success
I20260811 19:00:17.645071 833 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed: acquiring CA information for follower catalog manager: success
I20260811 19:00:17.645378 833 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 90565f46113a4e468bc56b63bbb023ed: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 19:00:17.894227 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 32751
I20260811 19:00:17.916244 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 425
I20260811 19:00:17.924765 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 595
2026-08-11T19:00:17Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3095 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:00:17 dist-test-slave-gjw7 krb5kdc[904](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:00:17 dist-test-slave-gjw7 krb5kdc[904](info): set up 2 sockets
Aug 11 19:00:17 dist-test-slave-gjw7 krb5kdc[904](info): commencing operation
krb5kdc: starting...
W20260811 19:00:19.150753 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:00:19 dist-test-slave-gjw7 krb5kdc[904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:00:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:00:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:00:19.268329 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:37269
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:43095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:37269
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:19.349625 933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:19.349830 933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:19.349849 933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:19.350978 933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:00:19.351020 933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:19.351033 933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:19.351046 933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:00:19.351068 933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:00:19.352509 933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:43095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:37269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:37269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:19.352742 933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:19.352950 933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:19.357821 947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:19.357795 944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:19.357836 933 server_base.cc:1034] running on GCE node
W20260811 19:00:19.357802 942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:19.358274 933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:19.358598 933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:19.359746 933 hybrid_clock.cc:648] HybridClock initialized: now 1786474819359732 us; error 29 us; skew 500 ppm
Aug 11 19:00:19 dist-test-slave-gjw7 krb5kdc[904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474819, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:19.362061 933 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:00:19.362481 933 webserver.cc:460] Webserver started at http://127.5.226.126:38099/ using document root <none> and password file <none>
I20260811 19:00:19.362671 933 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:19.362718 933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:19.362840 933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:19.364007 933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "4de3098253f544b9b8b41ea9ff27fe3c"
format_stamp: "Formatted at 2026-08-11 19:00:19 on dist-test-slave-gjw7"
server_key: "6b3b896ed10540d5726e01aaac551b9c"
server_key_iv: "8aa73140f88fab7fa8ac199b54428753"
server_key_version: "encryptionkey@0"
I20260811 19:00:19.364359 933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "4de3098253f544b9b8b41ea9ff27fe3c"
format_stamp: "Formatted at 2026-08-11 19:00:19 on dist-test-slave-gjw7"
server_key: "6b3b896ed10540d5726e01aaac551b9c"
server_key_iv: "8aa73140f88fab7fa8ac199b54428753"
server_key_version: "encryptionkey@0"
I20260811 19:00:19.365628 933 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 19:00:19.366343 963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:19.366498 933 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:00:19.366588 933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "4de3098253f544b9b8b41ea9ff27fe3c"
format_stamp: "Formatted at 2026-08-11 19:00:19 on dist-test-slave-gjw7"
server_key: "6b3b896ed10540d5726e01aaac551b9c"
server_key_iv: "8aa73140f88fab7fa8ac199b54428753"
server_key_version: "encryptionkey@0"
I20260811 19:00:19.366650 933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:19.378080 933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:19.379906 933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:19.380036 933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:19.383980 933 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:37269
I20260811 19:00:19.384011 1068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:37269 every 8 connection(s)
I20260811 19:00:19.384335 933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:00:19.385185 1069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:19.387524 1069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c: Bootstrap starting.
I20260811 19:00:19.388098 1069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:19.388373 1069 log.cc:824] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:19.389012 1069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c: No bootstrap required, opened a new log
I20260811 19:00:19.390854 1069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de3098253f544b9b8b41ea9ff27fe3c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37269 } }
I20260811 19:00:19.391002 1069 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:19.391058 1069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de3098253f544b9b8b41ea9ff27fe3c, State: Initialized, Role: FOLLOWER
I20260811 19:00:19.391212 1069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de3098253f544b9b8b41ea9ff27fe3c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37269 } }
I20260811 19:00:19.391283 1069 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:00:19.391309 1069 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:00:19.391359 1069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:19.391889 1069 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de3098253f544b9b8b41ea9ff27fe3c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37269 } }
I20260811 19:00:19.391988 1069 leader_election.cc:302] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4de3098253f544b9b8b41ea9ff27fe3c; no voters:
I20260811 19:00:19.392164 1069 leader_election.cc:288] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:00:19.392180 1074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:00:19.392309 1074 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [term 1 LEADER]: Becoming Leader. State: Replica: 4de3098253f544b9b8b41ea9ff27fe3c, State: Running, Role: LEADER
I20260811 19:00:19.392427 1069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:00:19.392408 1074 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de3098253f544b9b8b41ea9ff27fe3c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37269 } }
I20260811 19:00:19.392815 1077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4de3098253f544b9b8b41ea9ff27fe3c. Latest consensus state: current_term: 1 leader_uuid: "4de3098253f544b9b8b41ea9ff27fe3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de3098253f544b9b8b41ea9ff27fe3c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37269 } } }
I20260811 19:00:19.392937 1075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4de3098253f544b9b8b41ea9ff27fe3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de3098253f544b9b8b41ea9ff27fe3c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37269 } } }
I20260811 19:00:19.392951 1077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:19.393038 1075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:19.393426 1105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:00:19.393504 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 933
I20260811 19:00:19.393615 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:00:19.393837 6025 external_mini_cluster.cc:1428] Setting key 4111a344fb2f6aff58442b80867f31b6
I20260811 19:00:19.393980 1105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:00:19.395545 1105 catalog_manager.cc:1347] Generated new cluster ID: 6331e4f1c31c4ef7b60283358d5c45cf
I20260811 19:00:19.395601 1105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 19:00:19 dist-test-slave-gjw7 krb5kdc[904](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:19.403419 1105 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:00:19.404042 1105 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:00:19.405849 1126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:19.394437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43104 (local address 127.5.226.126:37269)
0811 19:00:19.394615 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:19.394624 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:19.394779 (+ 155us) server_negotiation.cc:407] Connection header received
0811 19:00:19.394896 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:19.394903 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:19.394978 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:19.395125 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:19.395916 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:19.397343 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:19.398434 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:19.399035 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:19.399109 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:19.402010 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:19.402015 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:19.402015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:19.402044 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:19.404062 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:19.404485 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:19.404488 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:19.404488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:19.404591 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:19.404813 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:19.404814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:19.404814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:19.405063 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:19.405165 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:19.405458 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 19:00:19.405606 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
I20260811 19:00:19.406930 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:00:19.411118 1105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4de3098253f544b9b8b41ea9ff27fe3c: Generated new TSK 0
I20260811 19:00:19.411269 1105 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:00:19.460654 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 933
2026-08-11T19:00:19Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1556 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:00:19 dist-test-slave-gjw7 krb5kdc[1138](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:00:19 dist-test-slave-gjw7 krb5kdc[1138](info): set up 2 sockets
Aug 11 19:00:19 dist-test-slave-gjw7 krb5kdc[1138](info): commencing operation
krb5kdc: starting...
W20260811 19:00:20.700322 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:00:20 dist-test-slave-gjw7 krb5kdc[1138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:00:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:00:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:00:20.825572 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:42441
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:42441
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:20.907927 1169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:20.908174 1169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:20.908198 1169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:20.909430 1169 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:00:20.909478 1169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:20.909493 1169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:20.909507 1169 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:00:20.909521 1169 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:00:20.911079 1169 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:42441
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:42441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:20.911340 1169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:20.911578 1169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:20.916496 1179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:20.916544 1178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:20.916501 1182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:20.917096 1169 server_base.cc:1034] running on GCE node
I20260811 19:00:20.917469 1169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:20.917804 1169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:20.918972 1169 hybrid_clock.cc:648] HybridClock initialized: now 1786474820918948 us; error 31 us; skew 500 ppm
Aug 11 19:00:20 dist-test-slave-gjw7 krb5kdc[1138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474820, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:20.921574 1169 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:00:20.922041 1169 webserver.cc:460] Webserver started at http://127.5.226.126:42971/ using document root <none> and password file <none>
I20260811 19:00:20.922251 1169 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:20.922305 1169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:20.922439 1169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:20.923533 1169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "1e3bb43510ac4fd2bfbb676317741b8b"
format_stamp: "Formatted at 2026-08-11 19:00:20 on dist-test-slave-gjw7"
server_key: "0da0f8ef1b4c255c5f6ef0c37aee37af"
server_key_iv: "0fc465415ba699c21dce83ca5a276be3"
server_key_version: "encryptionkey@0"
I20260811 19:00:20.923911 1169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "1e3bb43510ac4fd2bfbb676317741b8b"
format_stamp: "Formatted at 2026-08-11 19:00:20 on dist-test-slave-gjw7"
server_key: "0da0f8ef1b4c255c5f6ef0c37aee37af"
server_key_iv: "0fc465415ba699c21dce83ca5a276be3"
server_key_version: "encryptionkey@0"
I20260811 19:00:20.925272 1169 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 19:00:20.926067 1208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:20.926249 1169 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 19:00:20.926340 1169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "1e3bb43510ac4fd2bfbb676317741b8b"
format_stamp: "Formatted at 2026-08-11 19:00:20 on dist-test-slave-gjw7"
server_key: "0da0f8ef1b4c255c5f6ef0c37aee37af"
server_key_iv: "0fc465415ba699c21dce83ca5a276be3"
server_key_version: "encryptionkey@0"
I20260811 19:00:20.926411 1169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:20.953223 1169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:20.955484 1169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:20.955632 1169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:20.959787 1169 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:42441
I20260811 19:00:20.959820 1312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:42441 every 8 connection(s)
I20260811 19:00:20.960166 1169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:00:20.960880 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 1169
I20260811 19:00:20.960999 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:00:20.961202 6025 external_mini_cluster.cc:1428] Setting key 278ad2c531660f767544dae950c41d85
I20260811 19:00:20.961393 1318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:20.964432 1318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Bootstrap starting.
I20260811 19:00:20.965070 1318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:20.965379 1318 log.cc:824] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:20.966079 1318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: No bootstrap required, opened a new log
Aug 11 19:00:20 dist-test-slave-gjw7 krb5kdc[1138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:20.968282 1318 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } }
I20260811 19:00:20.968437 1318 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:20.968461 1318 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3bb43510ac4fd2bfbb676317741b8b, State: Initialized, Role: FOLLOWER
I20260811 19:00:20.968588 1318 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } }
I20260811 19:00:20.968663 1318 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:00:20.968694 1318 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:00:20.968741 1318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:20.969264 1318 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } }
I20260811 19:00:20.969393 1318 leader_election.cc:302] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e3bb43510ac4fd2bfbb676317741b8b; no voters:
I20260811 19:00:20.969552 1318 leader_election.cc:288] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:00:20.969607 1327 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:00:20.969744 1327 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 1 LEADER]: Becoming Leader. State: Replica: 1e3bb43510ac4fd2bfbb676317741b8b, State: Running, Role: LEADER
I20260811 19:00:20.969843 1318 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:00:20.969892 1327 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } }
I20260811 19:00:20.970610 1328 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } } }
I20260811 19:00:20.970702 1328 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:20.970602 1331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e3bb43510ac4fd2bfbb676317741b8b. Latest consensus state: current_term: 1 leader_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } } }
I20260811 19:00:20.971182 1331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: This master's current role is: LEADER
W20260811 19:00:20.971779 1362 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:00:20.971836 1362 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:00:20.971890 1342 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:00:20.972021 1324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:20.961925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39130 (local address 127.5.226.126:42441)
0811 19:00:20.962103 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:20.962112 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:20.962138 (+ 26us) server_negotiation.cc:407] Connection header received
0811 19:00:20.962546 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:20.962553 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:20.962601 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:20.962728 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:20.963364 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:20.964267 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:20.965042 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:20.965607 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:20.965704 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:20.968291 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:20.968295 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:20.968296 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:20.968307 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:20.970146 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:20.970521 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:20.970523 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:20.970524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:20.970631 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:20.970863 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:20.970864 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:20.970865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:20.971198 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:20.971360 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:20.971616 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 19:00:20.971770 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":84,"threads_started":1}
I20260811 19:00:20.972050 1342 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:00:20.973626 1342 catalog_manager.cc:1347] Generated new cluster ID: 6addc990b95b485998bd15f3521d6cd4
I20260811 19:00:20.973677 1342 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:00:20.986542 1342 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:00:20.987066 1342 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:00:20.990880 1342 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Generated new TSK 0
I20260811 19:00:20.991051 1342 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 19:00:21.024155 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:42441
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:21.109608 1370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:21.109835 1370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:21.109866 1370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:21.111013 1370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:21.111053 1370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:21.111088 1370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 19:00:21.112558 1370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:42441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1370
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:21.112792 1370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:21.113004 1370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:21.117930 1380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:21.118053 1370 server_base.cc:1034] running on GCE node
W20260811 19:00:21.117930 1375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:21.118060 1377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:21.118367 1370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:21.118635 1370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:21.119789 1370 hybrid_clock.cc:648] HybridClock initialized: now 1786474821119768 us; error 35 us; skew 500 ppm
Aug 11 19:00:21 dist-test-slave-gjw7 krb5kdc[1138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474821, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:21.122372 1370 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 19:00:21.122782 1370 webserver.cc:460] Webserver started at http://127.5.226.65:41119/ using document root <none> and password file <none>
I20260811 19:00:21.122973 1370 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:21.123019 1370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:21.123144 1370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:21.124161 1370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "e347ca754e46473cb650b6b3449268f5"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "95ae94652c2a8ec459b7f59b08e3f3e2"
server_key_iv: "5d1e4003c8a298301c3a8f6836e905b2"
server_key_version: "encryptionkey@0"
I20260811 19:00:21.124506 1370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "e347ca754e46473cb650b6b3449268f5"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "95ae94652c2a8ec459b7f59b08e3f3e2"
server_key_iv: "5d1e4003c8a298301c3a8f6836e905b2"
server_key_version: "encryptionkey@0"
I20260811 19:00:21.125849 1370 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 19:00:21.126559 1397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:21.126736 1370 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:00:21.126825 1370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "e347ca754e46473cb650b6b3449268f5"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "95ae94652c2a8ec459b7f59b08e3f3e2"
server_key_iv: "5d1e4003c8a298301c3a8f6836e905b2"
server_key_version: "encryptionkey@0"
I20260811 19:00:21.126888 1370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:21.135388 1370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:21.137092 1370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:21.137238 1370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:21.137497 1370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:21.137789 1370 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:21.137821 1370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:21.137849 1370 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:21.137874 1370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:21.143373 1370 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:33927
I20260811 19:00:21.143443 1633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:33927 every 8 connection(s)
I20260811 19:00:21.143713 1370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
Aug 11 19:00:21 dist-test-slave-gjw7 krb5kdc[1138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474821, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:21.150724 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 1370
I20260811 19:00:21.150854 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 19:00:21.151068 6025 external_mini_cluster.cc:1428] Setting key bf84be4f0600a4ee739ddfb122c9d9c8
I20260811 19:00:21.152412 1324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.144372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:56543 (local address 127.5.226.126:42441)
0811 19:00:21.144448 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:21.144451 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:21.144649 (+ 198us) server_negotiation.cc:407] Connection header received
0811 19:00:21.145137 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:21.145139 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:21.145148 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:21.145183 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:21.146142 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.146644 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.147557 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.147746 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.147795 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.149687 (+ 1892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:21.149688 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:21.149689 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:21.149696 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:21.151043 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:21.151446 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:21.151448 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:21.151448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:21.151508 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:21.151763 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:21.151764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:21.151765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:21.151894 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:21.151957 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:21.152207 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 19:00:21.152318 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 19:00:21.152554 1639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.144337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:56543)
0811 19:00:21.144497 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:21.144534 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:21.145046 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:21.145270 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:21.145274 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:21.145872 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:21.146061 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.146066 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.146705 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.146705 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.147497 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.147500 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.147801 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.147801 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.147893 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.148297 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:21.148305 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:21.149604 (+ 1299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:21.151122 (+ 1518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:21.151130 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:21.151133 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:21.151379 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:21.151563 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:21.151564 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:21.151564 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:21.151695 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:21.151955 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:21.151963 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:21.152087 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 19:00:21.152174 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 19:00:21.152338 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":86,"threads_started":1}
I20260811 19:00:21.153021 1634 heartbeater.cc:347] Connected to a master server at 127.5.226.126:42441
I20260811 19:00:21.153129 1634 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:21.153348 1634 heartbeater.cc:511] Master 127.5.226.126:42441 requested a full tablet report, sending...
I20260811 19:00:21.153903 1243 ts_manager.cc:194] Registered new tserver with Master: e347ca754e46473cb650b6b3449268f5 (127.5.226.65:33927)
I20260811 19:00:21.154495 1243 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:56543
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 19:00:21.176517 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:42441
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:21.259467 1643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:21.259670 1643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:21.259693 1643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:21.260780 1643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:21.260813 1643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:21.260838 1643 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 19:00:21.262331 1643 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:42441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1643
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:21.262538 1643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:21.262723 1643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:21.267623 1657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:21.267743 1643 server_base.cc:1034] running on GCE node
W20260811 19:00:21.267840 1655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:21.267622 1659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:21.268071 1643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:21.268316 1643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:21.269459 1643 hybrid_clock.cc:648] HybridClock initialized: now 1786474821269446 us; error 27 us; skew 500 ppm
Aug 11 19:00:21 dist-test-slave-gjw7 krb5kdc[1138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474821, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:21.276512 1643 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 19:00:21.276966 1643 webserver.cc:460] Webserver started at http://127.5.226.66:33137/ using document root <none> and password file <none>
I20260811 19:00:21.277171 1643 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:21.277220 1643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:21.277365 1643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:21.278405 1643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "67c88450e2434c959eeab19fd37df483"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "f37255ca833bed206e414cb56f2f80a6"
server_key_iv: "2283a3e8a9e08e55b78439a49a4a89b8"
server_key_version: "encryptionkey@0"
I20260811 19:00:21.278741 1643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "67c88450e2434c959eeab19fd37df483"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "f37255ca833bed206e414cb56f2f80a6"
server_key_iv: "2283a3e8a9e08e55b78439a49a4a89b8"
server_key_version: "encryptionkey@0"
I20260811 19:00:21.279985 1643 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 19:00:21.280719 1674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:21.280895 1643 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 19:00:21.280984 1643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "67c88450e2434c959eeab19fd37df483"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "f37255ca833bed206e414cb56f2f80a6"
server_key_iv: "2283a3e8a9e08e55b78439a49a4a89b8"
server_key_version: "encryptionkey@0"
I20260811 19:00:21.281046 1643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:21.293907 1643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:21.295864 1643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:21.296020 1643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:21.296243 1643 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:21.296564 1643 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:21.296598 1643 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:21.296629 1643 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:21.296653 1643 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:21.302430 1643 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:35595
I20260811 19:00:21.302484 1905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:35595 every 8 connection(s)
I20260811 19:00:21.302793 1643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
Aug 11 19:00:21 dist-test-slave-gjw7 krb5kdc[1138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474821, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:21.311184 1324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.303432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:36755 (local address 127.5.226.126:42441)
0811 19:00:21.303514 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:21.303516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:21.303690 (+ 174us) server_negotiation.cc:407] Connection header received
0811 19:00:21.304166 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:21.304167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:21.304178 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:21.304249 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:21.305152 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.305739 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.306696 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.306904 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.306959 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.308940 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:21.308942 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:21.308942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:21.308949 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:21.310114 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:21.310481 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:21.310482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:21.310483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:21.310530 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:21.310707 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:21.310707 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:21.310707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:21.310813 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:21.310858 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:21.311057 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 19:00:21.311118 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 19:00:21.311378 1914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.303416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:36755)
0811 19:00:21.303572 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:21.303609 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:21.304083 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:21.304307 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:21.304310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:21.304862 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:21.305063 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.305068 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.305820 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.305821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.306611 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.306613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.306966 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.306966 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.307061 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.307524 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:21.307533 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:21.308860 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:21.310186 (+ 1326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:21.310193 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:21.310195 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:21.310425 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:21.310576 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:21.310576 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:21.310577 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:21.310666 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:21.310855 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:21.310858 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:21.310966 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 19:00:21.311040 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 19:00:21.311158 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
I20260811 19:00:21.311818 1908 heartbeater.cc:347] Connected to a master server at 127.5.226.126:42441
I20260811 19:00:21.311904 1908 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:21.312052 1908 heartbeater.cc:511] Master 127.5.226.126:42441 requested a full tablet report, sending...
I20260811 19:00:21.312306 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 1643
I20260811 19:00:21.312399 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 19:00:21.312448 1243 ts_manager.cc:194] Registered new tserver with Master: 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595)
I20260811 19:00:21.312585 6025 external_mini_cluster.cc:1428] Setting key d9587fe0a911c70a446b669f4505aa8c
I20260811 19:00:21.312873 1243 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:36755
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 19:00:21.339608 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:42441
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:21.423733 1919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:21.423942 1919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:21.423967 1919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:21.425081 1919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:21.425127 1919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:21.425168 1919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 19:00:21.426677 1919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:42441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:21.426914 1919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:21.427137 1919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:21.432155 1931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:21.432159 1926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:21.432161 1928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:21.432461 1919 server_base.cc:1034] running on GCE node
I20260811 19:00:21.432611 1919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:21.432806 1919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:21.433935 1919 hybrid_clock.cc:648] HybridClock initialized: now 1786474821433917 us; error 29 us; skew 500 ppm
Aug 11 19:00:21 dist-test-slave-gjw7 krb5kdc[1138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474821, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:21.436260 1919 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 19:00:21.436641 1919 webserver.cc:460] Webserver started at http://127.5.226.67:40967/ using document root <none> and password file <none>
I20260811 19:00:21.436837 1919 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:21.436877 1919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:21.436968 1919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:21.437987 1919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "c083f54a36254981a695dc33b42a20ad"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "57549c0fc7dc6a0776bcf197c6e2a178"
server_key_iv: "def58d1dbcdd1ad3735d8eea17ffcc24"
server_key_version: "encryptionkey@0"
I20260811 19:00:21.438284 1919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "c083f54a36254981a695dc33b42a20ad"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "57549c0fc7dc6a0776bcf197c6e2a178"
server_key_iv: "def58d1dbcdd1ad3735d8eea17ffcc24"
server_key_version: "encryptionkey@0"
I20260811 19:00:21.439555 1919 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:00:21.440285 1941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:21.440460 1919 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:00:21.440549 1919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "c083f54a36254981a695dc33b42a20ad"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "57549c0fc7dc6a0776bcf197c6e2a178"
server_key_iv: "def58d1dbcdd1ad3735d8eea17ffcc24"
server_key_version: "encryptionkey@0"
I20260811 19:00:21.440611 1919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:21.452457 1919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:21.454169 1919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:21.454296 1919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:21.454497 1919 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:21.454787 1919 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:21.454820 1919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:21.454849 1919 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:21.454864 1919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:21.460515 1919 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:45069
I20260811 19:00:21.460554 2176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:45069 every 8 connection(s)
I20260811 19:00:21.460852 1919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 19:00:21.465143 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 1919
I20260811 19:00:21.465233 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 19:00:21.465447 6025 external_mini_cluster.cc:1428] Setting key 7d7eb625edf6402d5c96dbbdecc88b52
Aug 11 19:00:21 dist-test-slave-gjw7 krb5kdc[1138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474821, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:21.469674 1324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.461559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:50233 (local address 127.5.226.126:42441)
0811 19:00:21.461603 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:21.461604 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:21.461798 (+ 194us) server_negotiation.cc:407] Connection header received
0811 19:00:21.462267 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:21.462268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:21.462278 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:21.462335 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:21.463298 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.463801 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.464783 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.464985 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.465047 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.467309 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:21.467311 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:21.467311 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:21.467319 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:21.468381 (+ 1062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:21.468737 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:21.468739 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:21.468739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:21.468800 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:21.469015 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:21.469016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:21.469016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:21.469127 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:21.469183 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:21.469502 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 19:00:21.469586 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 19:00:21.469836 2180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.461516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:50233)
0811 19:00:21.461670 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:21.461719 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:21.462185 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:21.462390 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:21.462393 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:21.462999 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:21.463194 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.463200 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.463885 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.463886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.464691 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.464694 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.465059 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.465060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.465162 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.465784 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:21.465806 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:21.467199 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:21.468454 (+ 1255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:21.468461 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:21.468463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:21.468672 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:21.468856 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:21.468856 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:21.468857 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:21.468960 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:21.469181 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:21.469188 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:21.469357 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 19:00:21.469454 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 19:00:21.469609 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260811 19:00:21.470278 2177 heartbeater.cc:347] Connected to a master server at 127.5.226.126:42441
I20260811 19:00:21.470404 2177 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:21.470633 2177 heartbeater.cc:511] Master 127.5.226.126:42441 requested a full tablet report, sending...
I20260811 19:00:21.470983 1237 ts_manager.cc:194] Registered new tserver with Master: c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069)
I20260811 19:00:21.471398 1237 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:50233
I20260811 19:00:21.477111 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 19:00:21.483707 1324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.478368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39142 (local address 127.5.226.126:42441)
0811 19:00:21.478407 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:21.478409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:21.478506 (+ 97us) server_negotiation.cc:407] Connection header received
0811 19:00:21.478566 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:21.478566 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:21.478576 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:21.478622 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:21.479166 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.479649 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.480334 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.480516 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.480568 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.481636 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:21.481637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:21.481637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:21.481645 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:21.482667 (+ 1022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:21.482963 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:21.482964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:21.482964 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:21.483017 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:21.483171 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:21.483171 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:21.483172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:21.483322 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:21.483421 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:21.483510 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 19:00:21.483616 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 19:00:21.485028 1237 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39142:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 19:00:21.486608 1237 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 19:00:21.493893 2192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.488802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:33927 (local address 127.0.0.1:58046)
0811 19:00:21.489352 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:21.489401 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:21.489470 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:21.490064 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:21.490065 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:21.490068 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:21.490126 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.490128 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.491367 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.491368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.492637 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.492641 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.493604 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.493605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.493691 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.493706 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 19:00:21.493751 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 19:00:21.493805 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"mutex_wait_us":160,"thread_start_us":65,"threads_started":1}
I20260811 19:00:21.494112 2197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.489145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56066 (local address 127.5.226.67:45069)
0811 19:00:21.489608 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:21.489612 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:21.489622 (+ 10us) server_negotiation.cc:407] Connection header received
0811 19:00:21.489661 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:21.489663 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:21.489677 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:21.489747 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:21.489969 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.491096 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.492749 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.493505 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.493553 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.493619 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:21.493854 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 19:00:21.493897 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":118,"threads_started":1}
I20260811 19:00:21.494436 2193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.488802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:45069 (local address 127.0.0.1:56066)
0811 19:00:21.489542 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:21.489550 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:21.489587 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:21.489794 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:21.489798 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:21.489800 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:21.489883 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.489885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.491232 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.491234 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.492639 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.492641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.493674 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.493674 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.493738 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.493741 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:00:21.493784 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 19:00:21.493813 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":66,"threads_started":1}
I20260811 19:00:21.494464 2200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.489188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58046 (local address 127.5.226.65:33927)
0811 19:00:21.489896 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:21.489900 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:21.489909 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:00:21.489947 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:21.489950 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:21.489964 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:21.490040 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:21.490218 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.491241 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.492727 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.493504 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.494174 (+ 670us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.494329 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:21.494354 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 19:00:21.494394 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":116,"threads_started":1}
I20260811 19:00:21.495237 1499 tablet_service.cc:1467] Processing CreateTablet for tablet 4384b305441a4668b46fed7b6f80a5b4 (DEFAULT_TABLE table=test-table [id=971bf11ccd58478985564136e41f0a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:00:21.495568 1499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4384b305441a4668b46fed7b6f80a5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:21.497399 2195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.489015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:35595 (local address 127.0.0.1:53420)
0811 19:00:21.489370 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:21.489401 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:21.489470 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:21.491451 (+ 1981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:21.491452 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:21.491454 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:21.491494 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.491495 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.493280 (+ 1785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.493281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.494809 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.494813 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.497157 (+ 2344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.497159 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.497239 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.497245 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 19:00:21.497275 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 19:00:21.497335 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":58,"threads_started":1}
I20260811 19:00:21.497661 2201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.491084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53420 (local address 127.5.226.66:35595)
0811 19:00:21.491263 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:21.491268 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:21.491279 (+ 11us) server_negotiation.cc:407] Connection header received
0811 19:00:21.491318 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:21.491320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:21.491335 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:21.491412 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:21.491599 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.493119 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.494926 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.495829 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.497494 (+ 1665us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.497546 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:21.497567 (+ 21us) server_negotiation.cc:299] Negotiation successful
0811 19:00:21.497601 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":92,"threads_started":1}
I20260811 19:00:21.497817 2036 tablet_service.cc:1467] Processing CreateTablet for tablet 4384b305441a4668b46fed7b6f80a5b4 (DEFAULT_TABLE table=test-table [id=971bf11ccd58478985564136e41f0a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:00:21.498167 2036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4384b305441a4668b46fed7b6f80a5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:21.498821 2202 tablet_bootstrap.cc:492] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Bootstrap starting.
I20260811 19:00:21.499486 2202 tablet_bootstrap.cc:654] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:21.499955 2202 log.cc:824] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:21.500578 2202 tablet_bootstrap.cc:492] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: No bootstrap required, opened a new log
I20260811 19:00:21.500622 2202 ts_tablet_manager.cc:1397] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 19:00:21.501003 2208 tablet_bootstrap.cc:492] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad: Bootstrap starting.
I20260811 19:00:21.501685 2208 tablet_bootstrap.cc:654] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:21.501829 1774 tablet_service.cc:1467] Processing CreateTablet for tablet 4384b305441a4668b46fed7b6f80a5b4 (DEFAULT_TABLE table=test-table [id=971bf11ccd58478985564136e41f0a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:00:21.502177 1774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4384b305441a4668b46fed7b6f80a5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:21.502215 2208 log.cc:824] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:21.502528 2202 raft_consensus.cc:348] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } } peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } }
I20260811 19:00:21.502710 2202 raft_consensus.cc:374] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:21.502755 2202 raft_consensus.cc:729] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e347ca754e46473cb650b6b3449268f5, State: Initialized, Role: FOLLOWER
I20260811 19:00:21.502935 2208 tablet_bootstrap.cc:492] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad: No bootstrap required, opened a new log
I20260811 19:00:21.502897 2202 consensus_queue.cc:260] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } } peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } }
I20260811 19:00:21.502997 2208 ts_tablet_manager.cc:1397] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 19:00:21.503154 2202 ts_tablet_manager.cc:1428] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 19:00:21.504384 2208 raft_consensus.cc:348] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } } peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } }
I20260811 19:00:21.504515 2208 raft_consensus.cc:374] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:21.504546 2208 raft_consensus.cc:729] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c083f54a36254981a695dc33b42a20ad, State: Initialized, Role: FOLLOWER
I20260811 19:00:21.504655 2208 consensus_queue.cc:260] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } } peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } }
I20260811 19:00:21.504868 2211 tablet_bootstrap.cc:492] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483: Bootstrap starting.
I20260811 19:00:21.504922 2177 heartbeater.cc:503] Master 127.5.226.126:42441 was elected leader, sending a full tablet report...
I20260811 19:00:21.505033 1634 heartbeater.cc:503] Master 127.5.226.126:42441 was elected leader, sending a full tablet report...
I20260811 19:00:21.505162 2208 ts_tablet_manager.cc:1428] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 19:00:21.505534 2211 tablet_bootstrap.cc:654] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:21.506079 2211 log.cc:824] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:21.506704 2211 tablet_bootstrap.cc:492] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483: No bootstrap required, opened a new log
I20260811 19:00:21.506762 2211 ts_tablet_manager.cc:1397] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 19:00:21.508095 2211 raft_consensus.cc:348] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } } peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } }
I20260811 19:00:21.508221 2211 raft_consensus.cc:374] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:21.508253 2211 raft_consensus.cc:729] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67c88450e2434c959eeab19fd37df483, State: Initialized, Role: FOLLOWER
I20260811 19:00:21.508354 2211 consensus_queue.cc:260] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } } peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } }
I20260811 19:00:21.508622 2211 ts_tablet_manager.cc:1428] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:00:21.508656 1908 heartbeater.cc:503] Master 127.5.226.126:42441 was elected leader, sending a full tablet report...
W20260811 19:00:21.553376 1913 tablet.cc:2369] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 19:00:21.644445 1637 tablet.cc:2369] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 19:00:21.711434 2178 tablet.cc:2369] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:00:21.780275 2216 raft_consensus.cc:482] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:00:21.780416 2216 raft_consensus.cc:504] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } } peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } }
I20260811 19:00:21.780857 2216 leader_election.cc:288] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e347ca754e46473cb650b6b3449268f5 (127.5.226.65:33927), c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069)
I20260811 19:00:21.783814 1914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.781047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:33927 (local address 127.5.226.66:36619)
0811 19:00:21.781104 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:21.781116 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:21.781162 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:21.781440 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:21.781441 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:21.781443 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:21.781515 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.781517 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.782215 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.782216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.782948 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.782950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.783608 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.783609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.783673 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.783677 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:00:21.783720 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 19:00:21.783754 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 19:00:21.783840 2200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.781133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:36619 (local address 127.5.226.65:33927)
0811 19:00:21.781192 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:21.781194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:21.781205 (+ 11us) server_negotiation.cc:407] Connection header received
0811 19:00:21.781261 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:21.781278 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:21.781320 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:21.781377 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:21.781593 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.782135 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.783031 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.783540 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.783609 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.783618 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:21.783737 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 19:00:21.783774 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 19:00:21.784149 2197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.781155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:49997 (local address 127.5.226.67:45069)
0811 19:00:21.781208 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:21.781210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:21.781467 (+ 257us) server_negotiation.cc:407] Connection header received
0811 19:00:21.781573 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:21.781574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:21.781584 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:21.781610 (+ 26us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:21.781872 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.782334 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.783256 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.783799 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.783864 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.783872 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:21.784039 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 19:00:21.784090 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 19:00:21.784161 1538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4384b305441a4668b46fed7b6f80a5b4" candidate_uuid: "67c88450e2434c959eeab19fd37df483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e347ca754e46473cb650b6b3449268f5" is_pre_election: true
I20260811 19:00:21.784360 2219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.781052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:45069 (local address 127.5.226.66:49997)
0811 19:00:21.781406 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:21.781415 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:21.781498 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:21.781676 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:21.781677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:21.781679 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:21.781754 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.781756 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.782412 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.782413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.783167 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:21.783169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.783880 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.783881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:21.783952 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.783956 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:00:21.784244 (+ 288us) client_negotiation.cc:240] Negotiation successful
0811 19:00:21.784289 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":158,"thread_start_us":122,"threads_started":1}
I20260811 19:00:21.784361 1538 raft_consensus.cc:2454] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67c88450e2434c959eeab19fd37df483 in term 0.
I20260811 19:00:21.784652 1680 leader_election.cc:302] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67c88450e2434c959eeab19fd37df483, e347ca754e46473cb650b6b3449268f5; no voters:
I20260811 19:00:21.784683 2081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4384b305441a4668b46fed7b6f80a5b4" candidate_uuid: "67c88450e2434c959eeab19fd37df483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c083f54a36254981a695dc33b42a20ad" is_pre_election: true
I20260811 19:00:21.784830 2081 raft_consensus.cc:2454] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67c88450e2434c959eeab19fd37df483 in term 0.
I20260811 19:00:21.784834 2216 raft_consensus.cc:2781] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 19:00:21.784900 2216 raft_consensus.cc:482] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 19:00:21.784937 2216 raft_consensus.cc:3037] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:21.785727 2216 raft_consensus.cc:504] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } } peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } }
I20260811 19:00:21.785844 2216 leader_election.cc:288] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [CANDIDATE]: Term 1 election: Requested vote from peers e347ca754e46473cb650b6b3449268f5 (127.5.226.65:33927), c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069)
I20260811 19:00:21.786020 2081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4384b305441a4668b46fed7b6f80a5b4" candidate_uuid: "67c88450e2434c959eeab19fd37df483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c083f54a36254981a695dc33b42a20ad"
I20260811 19:00:21.786074 1538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4384b305441a4668b46fed7b6f80a5b4" candidate_uuid: "67c88450e2434c959eeab19fd37df483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e347ca754e46473cb650b6b3449268f5"
I20260811 19:00:21.786090 2081 raft_consensus.cc:3037] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:21.786157 1538 raft_consensus.cc:3037] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:21.786846 2081 raft_consensus.cc:2454] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67c88450e2434c959eeab19fd37df483 in term 1.
I20260811 19:00:21.786854 1538 raft_consensus.cc:2454] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67c88450e2434c959eeab19fd37df483 in term 1.
I20260811 19:00:21.787019 1677 leader_election.cc:302] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67c88450e2434c959eeab19fd37df483, c083f54a36254981a695dc33b42a20ad; no voters:
I20260811 19:00:21.787106 2216 raft_consensus.cc:2781] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:00:21.787257 2216 raft_consensus.cc:686] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [term 1 LEADER]: Becoming Leader. State: Replica: 67c88450e2434c959eeab19fd37df483, State: Running, Role: LEADER
I20260811 19:00:21.787352 2216 consensus_queue.cc:237] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } } peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } }
I20260811 19:00:21.788159 1236 catalog_manager.cc:5495] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67c88450e2434c959eeab19fd37df483 (127.5.226.66). New cstate: current_term: 1 leader_uuid: "67c88450e2434c959eeab19fd37df483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } health_report { overall_health: UNKNOWN } } }
I20260811 19:00:21.855948 2201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.853724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53436 (local address 127.5.226.66:35595)
0811 19:00:21.853781 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:21.853783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:21.853793 (+ 10us) server_negotiation.cc:407] Connection header received
0811 19:00:21.853837 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:21.853838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:21.853859 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:21.853919 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:00:21.854025 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.854502 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.855229 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:21.855432 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:21.855483 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:21.855586 (+ 103us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:00:21.855686 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:00:21.855744 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:21.855827 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 19:00:21.855845 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 19:00:21.857905 2081 raft_consensus.cc:1261] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad [term 1 FOLLOWER]: Refusing update from remote peer 67c88450e2434c959eeab19fd37df483: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:00:21.857906 1538 raft_consensus.cc:1261] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Refusing update from remote peer 67c88450e2434c959eeab19fd37df483: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:00:21.858235 2220 consensus_queue.cc:1035] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:00:21.858374 2216 consensus_queue.cc:1035] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:00:21.860659 2225 mvcc.cc:205] Tried to move back new op lower bound from 7317400870327205888 to 7317400870041530368. Current Snapshot: MvccSnapshot[applied={T|T < 7317400870327205888}]
I20260811 19:00:21.860981 2229 mvcc.cc:205] Tried to move back new op lower bound from 7317400870327205888 to 7317400870041530368. Current Snapshot: MvccSnapshot[applied={T|T < 7317400870327205888}]
I20260811 19:00:21.861716 2227 mvcc.cc:205] Tried to move back new op lower bound from 7317400870327205888 to 7317400870041530368. Current Snapshot: MvccSnapshot[applied={T|T < 7317400870327205888}]
I20260811 19:00:21.863651 1237 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:00:21.863755 1237 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:00:21.864519 1237 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Sending DeleteTablet for 3 replicas of tablet 4384b305441a4668b46fed7b6f80a5b4
I20260811 19:00:21.864849 2036 tablet_service.cc:1514] Processing DeleteTablet for tablet 4384b305441a4668b46fed7b6f80a5b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:00:21 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:56066
I20260811 19:00:21.864879 1774 tablet_service.cc:1514] Processing DeleteTablet for tablet 4384b305441a4668b46fed7b6f80a5b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:00:21 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:53420
I20260811 19:00:21.864888 1499 tablet_service.cc:1514] Processing DeleteTablet for tablet 4384b305441a4668b46fed7b6f80a5b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:00:21 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:58046
I20260811 19:00:21.865146 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 1370
I20260811 19:00:21.865192 2246 tablet_replica.cc:330] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483: stopping tablet replica
I20260811 19:00:21.877041 2246 raft_consensus.cc:2229] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [term 1 LEADER]: Raft consensus shutting down.
I20260811 19:00:21.877497 2246 raft_consensus.cc:2258] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:00:21.878911 2246 ts_tablet_manager.cc:1905] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:00:21.880906 2246 ts_tablet_manager.cc:1918] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:00:21.881084 2246 log.cc:1196] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/4384b305441a4668b46fed7b6f80a5b4
I20260811 19:00:21.881491 2246 ts_tablet_manager.cc:1939] T 4384b305441a4668b46fed7b6f80a5b4 P 67c88450e2434c959eeab19fd37df483: Deleting consensus metadata
I20260811 19:00:21.882594 1216 catalog_manager.cc:4841] TS 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595): tablet 4384b305441a4668b46fed7b6f80a5b4 (table test-table [id=971bf11ccd58478985564136e41f0a22]) successfully deleted
I20260811 19:00:21.888386 2248 tablet_replica.cc:330] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad: stopping tablet replica
I20260811 19:00:21.888548 2248 raft_consensus.cc:2229] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:00:21.888685 2248 raft_consensus.cc:2258] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:00:21.889271 2248 ts_tablet_manager.cc:1905] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:00:21.891063 2248 ts_tablet_manager.cc:1918] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:00:21.891166 2248 log.cc:1196] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/4384b305441a4668b46fed7b6f80a5b4
I20260811 19:00:21.891484 2248 ts_tablet_manager.cc:1939] T 4384b305441a4668b46fed7b6f80a5b4 P c083f54a36254981a695dc33b42a20ad: Deleting consensus metadata
I20260811 19:00:21.892030 1212 catalog_manager.cc:4841] TS c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069): tablet 4384b305441a4668b46fed7b6f80a5b4 (table test-table [id=971bf11ccd58478985564136e41f0a22]) successfully deleted
W20260811 19:00:21.893155 1216 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:33927 (error 108)
I20260811 19:00:21.893442 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 1643
I20260811 19:00:21.898880 2195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:21.898698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:33927 (local address 127.0.0.1:58052)
0811 19:00:21.898766 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:21.898837 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:33927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 19:00:21.899034 1216 catalog_manager.cc:4584] TS e347ca754e46473cb650b6b3449268f5 (127.5.226.65:33927): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4384b305441a4668b46fed7b6f80a5b4: Network error: Client connection negotiation failed: client connection to 127.5.226.65:33927: connect: Connection refused (error 111)
I20260811 19:00:21.908813 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 1919
I20260811 19:00:21.925365 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 1169
I20260811 19:00:21.935288 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:42441
--webserver_interface=127.5.226.126
--webserver_port=42971
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:42441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:22.016817 2253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:22.017022 2253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:22.017050 2253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:22.018214 2253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:00:22.018255 2253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:22.018272 2253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:22.018287 2253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:00:22.018303 2253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:00:22.019748 2253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:42441
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:42441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=42971
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:22.020001 2253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:22.020211 2253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:22.029737 2266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:22.029829 2264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:22.029740 2271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:22.030020 2253 server_base.cc:1034] running on GCE node
I20260811 19:00:22.030330 2253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:22.030639 2253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:22.031781 2253 hybrid_clock.cc:648] HybridClock initialized: now 1786474822031766 us; error 26 us; skew 500 ppm
Aug 11 19:00:22 dist-test-slave-gjw7 krb5kdc[1138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474822, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:22.034363 2253 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:00:22.034829 2253 webserver.cc:460] Webserver started at http://127.5.226.126:42971/ using document root <none> and password file <none>
I20260811 19:00:22.035053 2253 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:22.035116 2253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:22.036561 2253 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 19:00:22.037187 2284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:22.037370 2253 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:00:22.037464 2253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "1e3bb43510ac4fd2bfbb676317741b8b"
format_stamp: "Formatted at 2026-08-11 19:00:20 on dist-test-slave-gjw7"
server_key: "0da0f8ef1b4c255c5f6ef0c37aee37af"
server_key_iv: "0fc465415ba699c21dce83ca5a276be3"
server_key_version: "encryptionkey@0"
I20260811 19:00:22.037894 2253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:22.047137 2253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:22.049311 2253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:22.049454 2253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:22.053432 2253 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:42441
I20260811 19:00:22.053478 2388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:42441 every 8 connection(s)
I20260811 19:00:22.053869 2253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:00:22.055537 2390 sys_catalog.cc:263] Verifying existing consensus state
I20260811 19:00:22.056263 2390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Bootstrap starting.
I20260811 19:00:22.060750 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 2253
I20260811 19:00:22.061086 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:33927
--local_ip_for_outbound_sockets=127.5.226.65
--tserver_master_addrs=127.5.226.126:42441
--webserver_port=41119
--webserver_interface=127.5.226.65
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:00:22.065601 2390 log.cc:824] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:22.067449 2390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 19:00:22.067729 2390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Bootstrap complete.
I20260811 19:00:22.070011 2390 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } }
I20260811 19:00:22.070240 2390 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3bb43510ac4fd2bfbb676317741b8b, State: Initialized, Role: FOLLOWER
I20260811 19:00:22.070389 2390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } }
I20260811 19:00:22.070456 2390 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:00:22.070492 2390 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:00:22.070537 2390 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 1 FOLLOWER]: Advancing to term 2
I20260811 19:00:22.071533 2390 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } }
I20260811 19:00:22.071626 2390 leader_election.cc:302] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e3bb43510ac4fd2bfbb676317741b8b; no voters:
I20260811 19:00:22.071797 2390 leader_election.cc:288] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 19:00:22.071848 2395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 2 FOLLOWER]: Leader election won for term 2
I20260811 19:00:22.072001 2395 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 2 LEADER]: Becoming Leader. State: Replica: 1e3bb43510ac4fd2bfbb676317741b8b, State: Running, Role: LEADER
I20260811 19:00:22.072077 2390 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:00:22.072152 2395 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } }
I20260811 19:00:22.072875 2398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } } }
I20260811 19:00:22.072961 2398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:22.072952 2399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e3bb43510ac4fd2bfbb676317741b8b. Latest consensus state: current_term: 2 leader_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } } }
I20260811 19:00:22.073213 2399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:22.073237 2413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:00:22.074076 2413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:00:22.074185 2413 catalog_manager.cc:1259] Loaded cluster ID: 6addc990b95b485998bd15f3521d6cd4
I20260811 19:00:22.074213 2413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:00:22.074445 2413 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 19:00:22.079089 2413 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 19:00:22.081647 2413 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:00:22.081868 2413 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Loaded TSK: 0
I20260811 19:00:22.082087 2413 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 19:00:22.146469 2392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:22.146724 2392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:22.146754 2392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:22.147943 2392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:22.147984 2392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:22.148011 2392 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 19:00:22.149492 2392 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:33927
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=41119
--tserver_master_addrs=127.5.226.126:42441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:22.149715 2392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:22.149937 2392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:22.154865 2449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:22.154894 2450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:22.154881 2453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:22.155277 2392 server_base.cc:1034] running on GCE node
I20260811 19:00:22.155475 2392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:22.155706 2392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:22.156880 2392 hybrid_clock.cc:648] HybridClock initialized: now 1786474822156874 us; error 40 us; skew 500 ppm
Aug 11 19:00:22 dist-test-slave-gjw7 krb5kdc[1138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474822, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:22.159590 2392 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 19:00:22.160100 2392 webserver.cc:460] Webserver started at http://127.5.226.65:41119/ using document root <none> and password file <none>
I20260811 19:00:22.160311 2392 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:22.160379 2392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:22.161747 2392 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 19:00:22.162426 2469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:22.162600 2392 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:00:22.162693 2392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "e347ca754e46473cb650b6b3449268f5"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "95ae94652c2a8ec459b7f59b08e3f3e2"
server_key_iv: "5d1e4003c8a298301c3a8f6836e905b2"
server_key_version: "encryptionkey@0"
I20260811 19:00:22.163077 2392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:22.175002 2392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:22.177039 2392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:22.177179 2392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:22.177426 2392 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:22.177930 2485 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 19:00:22.179436 2392 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 19:00:22.179489 2392 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 19:00:22.179517 2392 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 19:00:22.180158 2392 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 19:00:22.180202 2392 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 19:00:22.180272 2485 tablet_bootstrap.cc:492] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Bootstrap starting.
I20260811 19:00:22.187644 2392 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:33927
I20260811 19:00:22.188145 2392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 19:00:22.191847 2485 log.cc:824] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:22.192150 2707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:33927 every 8 connection(s)
I20260811 19:00:22.194460 2485 tablet_bootstrap.cc:492] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 19:00:22.194721 2485 tablet_bootstrap.cc:492] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Bootstrap complete.
I20260811 19:00:22.195856 2485 ts_tablet_manager.cc:1397] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.009s
Aug 11 19:00:22 dist-test-slave-gjw7 krb5kdc[1138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474822, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:22.196970 2485 raft_consensus.cc:348] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } } peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } }
I20260811 19:00:22.197335 2485 raft_consensus.cc:729] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e347ca754e46473cb650b6b3449268f5, State: Initialized, Role: FOLLOWER
I20260811 19:00:22.197463 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 2392
I20260811 19:00:22.197502 2485 consensus_queue.cc:260] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } } peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } }
I20260811 19:00:22.197748 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:35595
--local_ip_for_outbound_sockets=127.5.226.66
--tserver_master_addrs=127.5.226.126:42441
--webserver_port=33137
--webserver_interface=127.5.226.66
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:00:22.197799 2485 ts_tablet_manager.cc:1428] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20260811 19:00:22.200874 2714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.188889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:35905)
0811 19:00:22.189076 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:22.189128 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:22.189799 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:22.190315 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:22.190321 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:22.190722 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:22.191051 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.191061 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.192741 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.192742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.194044 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.194047 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.194902 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.194903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.195049 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.195654 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:22.195665 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:22.197462 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:22.199228 (+ 1766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:22.199235 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:22.199237 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:22.199456 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:22.199698 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:22.199699 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:22.199700 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:22.199804 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:22.200245 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:22.200249 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:22.200407 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 19:00:22.200509 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 19:00:22.200673 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":97,"threads_started":1}
I20260811 19:00:22.200925 2718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.189025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:35905 (local address 127.5.226.126:42441)
0811 19:00:22.189214 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:22.189223 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:22.189363 (+ 140us) server_negotiation.cc:407] Connection header received
0811 19:00:22.190039 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:22.190046 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:22.190105 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:22.190240 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:22.191194 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.192615 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.194150 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.194787 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.194916 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.197581 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:22.197585 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:22.197586 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:22.197598 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:22.199144 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:22.199543 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:22.199547 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:22.199548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:22.199635 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:22.199870 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:22.199871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:22.199871 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:22.200169 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:22.200253 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:22.200590 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 19:00:22.200730 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":93,"threads_started":1}
I20260811 19:00:22.202140 2710 heartbeater.cc:347] Connected to a master server at 127.5.226.126:42441
I20260811 19:00:22.202239 2710 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:22.202419 2710 heartbeater.cc:511] Master 127.5.226.126:42441 requested a full tablet report, sending...
I20260811 19:00:22.203131 2326 ts_manager.cc:194] Registered new tserver with Master: e347ca754e46473cb650b6b3449268f5 (127.5.226.65:33927)
I20260811 19:00:22.204170 2326 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:35905
I20260811 19:00:22.205572 2710 heartbeater.cc:503] Master 127.5.226.126:42441 was elected leader, sending a full tablet report...
I20260811 19:00:22.208994 2726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.204561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:33927 (local address 127.0.0.1:58068)
0811 19:00:22.204744 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:22.204788 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:22.204867 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:22.205782 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:22.205786 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:22.205789 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:22.205871 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.205873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.207080 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.207081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.207903 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.207905 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.208762 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.208763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.208838 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.208848 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 19:00:22.208901 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 19:00:22.208939 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":89,"threads_started":1}
I20260811 19:00:22.209040 2728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.205434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58068 (local address 127.5.226.65:33927)
0811 19:00:22.205595 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:22.205599 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:22.205610 (+ 11us) server_negotiation.cc:407] Connection header received
0811 19:00:22.205644 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:22.205646 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:22.205662 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:22.205952 (+ 290us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:22.206002 (+ 50us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.207003 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.207987 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.208682 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.208763 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.208835 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:22.208931 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 19:00:22.208974 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":80,"threads_started":1}
I20260811 19:00:22.209414 2564 tablet_service.cc:1514] Processing DeleteTablet for tablet 4384b305441a4668b46fed7b6f80a5b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:00:21 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:58068
I20260811 19:00:22.209897 2729 tablet_replica.cc:330] stopping tablet replica
I20260811 19:00:22.210002 2729 raft_consensus.cc:2229] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:00:22.210069 2729 raft_consensus.cc:2258] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:00:22.210372 2729 ts_tablet_manager.cc:1905] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:00:22.212626 2729 ts_tablet_manager.cc:1918] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:00:22.212703 2729 log.cc:1196] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal/wals/4384b305441a4668b46fed7b6f80a5b4
I20260811 19:00:22.212937 2729 ts_tablet_manager.cc:1939] T 4384b305441a4668b46fed7b6f80a5b4 P e347ca754e46473cb650b6b3449268f5: Deleting consensus metadata
I20260811 19:00:22.213538 2292 catalog_manager.cc:4841] TS e347ca754e46473cb650b6b3449268f5 (127.5.226.65:33927): tablet 4384b305441a4668b46fed7b6f80a5b4 (table test-table [id=971bf11ccd58478985564136e41f0a22]) successfully deleted
W20260811 19:00:22.286751 2725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:22.286969 2725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:22.286993 2725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:22.288184 2725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:22.288231 2725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:22.288260 2725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 19:00:22.289783 2725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:35595
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=33137
--tserver_master_addrs=127.5.226.126:42441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:22.290024 2725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:22.290253 2725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:22.295272 2745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:22.295430 2725 server_base.cc:1034] running on GCE node
W20260811 19:00:22.295281 2739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:22.295339 2738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:22.295728 2725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:22.296005 2725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:22.297147 2725 hybrid_clock.cc:648] HybridClock initialized: now 1786474822297130 us; error 35 us; skew 500 ppm
Aug 11 19:00:22 dist-test-slave-gjw7 krb5kdc[1138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474822, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:22.299568 2725 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 19:00:22.300037 2725 webserver.cc:460] Webserver started at http://127.5.226.66:33137/ using document root <none> and password file <none>
I20260811 19:00:22.300243 2725 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:22.300309 2725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:22.301669 2725 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:00:22.302239 2762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:22.302412 2725 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:00:22.302498 2725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "67c88450e2434c959eeab19fd37df483"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "f37255ca833bed206e414cb56f2f80a6"
server_key_iv: "2283a3e8a9e08e55b78439a49a4a89b8"
server_key_version: "encryptionkey@0"
I20260811 19:00:22.302868 2725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:22.313828 2725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:22.315953 2725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:22.316103 2725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:22.316349 2725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:22.316672 2725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:22.316707 2725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:22.316740 2725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:22.316757 2725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:22.322932 2725 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:35595
I20260811 19:00:22.322991 2984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:35595 every 8 connection(s)
I20260811 19:00:22.323340 2725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 19:00:22.324867 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 2725
I20260811 19:00:22.325122 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:45069
--local_ip_for_outbound_sockets=127.5.226.67
--tserver_master_addrs=127.5.226.126:42441
--webserver_port=40967
--webserver_interface=127.5.226.67
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 19:00:22 dist-test-slave-gjw7 krb5kdc[1138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474822, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:22.333336 2718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.324037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:37099 (local address 127.5.226.126:42441)
0811 19:00:22.324082 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:22.324084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:22.324273 (+ 189us) server_negotiation.cc:407] Connection header received
0811 19:00:22.324804 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:22.324805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:22.324822 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:22.324876 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:22.325930 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.326440 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.327834 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.328066 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.328144 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.330501 (+ 2357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:22.330503 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:22.330504 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:22.330513 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:22.331979 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:22.332360 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:22.332362 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:22.332362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:22.332429 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:22.332638 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:22.332639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:22.332639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:22.332793 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:22.332868 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:22.333091 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 19:00:22.333206 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 19:00:22.333428 2987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.324015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:37099)
0811 19:00:22.324156 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:22.324195 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:22.324691 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:22.324949 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:22.324952 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:22.325617 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:22.325830 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.325835 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.326534 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.326535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.327730 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.327734 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.328170 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.328171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.328303 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.328816 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:22.328824 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:22.330399 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:22.332058 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:22.332065 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:22.332067 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:22.332289 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:22.332485 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:22.332485 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:22.332486 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:22.332583 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:22.332851 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:22.332855 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:22.332974 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 19:00:22.333054 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 19:00:22.333189 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":72,"threads_started":1}
I20260811 19:00:22.333956 2985 heartbeater.cc:347] Connected to a master server at 127.5.226.126:42441
I20260811 19:00:22.334059 2985 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:22.334249 2985 heartbeater.cc:511] Master 127.5.226.126:42441 requested a full tablet report, sending...
I20260811 19:00:22.334656 2326 ts_manager.cc:194] Registered new tserver with Master: 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595)
I20260811 19:00:22.335166 2326 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:37099
W20260811 19:00:22.411827 2988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:22.412051 2988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:22.412076 2988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:22.413260 2988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:22.413352 2988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:22.413388 2988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 19:00:22.414896 2988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:45069
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=40967
--tserver_master_addrs=127.5.226.126:42441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:22.415094 2988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:22.415302 2988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:22.420197 2994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:22.420203 2996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:22.420207 3002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:22.420413 2988 server_base.cc:1034] running on GCE node
I20260811 19:00:22.420621 2988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:22.420881 2988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:22.422024 2988 hybrid_clock.cc:648] HybridClock initialized: now 1786474822422010 us; error 30 us; skew 500 ppm
Aug 11 19:00:22 dist-test-slave-gjw7 krb5kdc[1138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474822, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:22.424535 2988 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 19:00:22.424965 2988 webserver.cc:460] Webserver started at http://127.5.226.67:40967/ using document root <none> and password file <none>
I20260811 19:00:22.425197 2988 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:22.425263 2988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:22.426739 2988 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:00:22.427372 3011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:22.427536 2988 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:00:22.427625 2988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "c083f54a36254981a695dc33b42a20ad"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "57549c0fc7dc6a0776bcf197c6e2a178"
server_key_iv: "def58d1dbcdd1ad3735d8eea17ffcc24"
server_key_version: "encryptionkey@0"
I20260811 19:00:22.427992 2988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:22.442009 2988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:22.443929 2988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:22.444052 2988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:22.444283 2988 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:22.444600 2988 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:22.444633 2988 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:22.444656 2988 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:22.444679 2988 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:22.450045 2988 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:45069
I20260811 19:00:22.450111 3236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:45069 every 8 connection(s)
I20260811 19:00:22.450425 2988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 19:00:22.451571 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 2988
Aug 11 19:00:22 dist-test-slave-gjw7 krb5kdc[1138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474822, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:22.457981 3247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.451922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39144 (local address 127.5.226.126:42441)
0811 19:00:22.452016 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:22.452017 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:22.452126 (+ 109us) server_negotiation.cc:407] Connection header received
0811 19:00:22.452182 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:22.452183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:22.452194 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:22.452249 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:22.452789 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.453330 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.454041 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.454243 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.454298 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.455510 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:22.455512 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:22.455512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:22.455519 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:22.456908 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:22.457250 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:22.457251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:22.457252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:22.457323 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:22.457508 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:22.457509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:22.457509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:22.457612 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:22.457766 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:22.457813 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 19:00:22.457886 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75,"thread_start_us":45,"threads_started":1}
I20260811 19:00:22.459116 2718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.451090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:59651 (local address 127.5.226.126:42441)
0811 19:00:22.451134 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:22.451135 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:22.451375 (+ 240us) server_negotiation.cc:407] Connection header received
0811 19:00:22.451950 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:22.451952 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:22.451964 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:22.452018 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:22.452938 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.453438 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.454376 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.454554 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.454604 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.456532 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:22.456533 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:22.456533 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:22.456540 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:22.457790 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:22.458248 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:22.458249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:22.458249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:22.458304 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:22.458566 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:22.458567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:22.458567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:22.458696 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:22.458762 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:22.458998 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 19:00:22.459057 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":18}
I20260811 19:00:22.459259 3243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.451078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:59651)
0811 19:00:22.451254 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:22.451297 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:22.451821 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:22.452095 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:22.452099 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:22.452656 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:22.452848 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.452853 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.453515 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.453516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.454298 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.454301 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.454620 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.454621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.454747 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.455149 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:22.455157 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:22.456448 (+ 1291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:22.457867 (+ 1419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:22.457874 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:22.457876 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:22.458156 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:22.458374 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:22.458374 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:22.458375 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:22.458502 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:22.458772 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:22.458779 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:22.458895 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 19:00:22.458978 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 19:00:22.459091 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":95,"threads_started":1}
I20260811 19:00:22.459668 3237 heartbeater.cc:347] Connected to a master server at 127.5.226.126:42441
I20260811 19:00:22.459751 3237 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:22.459920 3237 heartbeater.cc:511] Master 127.5.226.126:42441 requested a full tablet report, sending...
I20260811 19:00:22.460249 2326 ts_manager.cc:194] Registered new tserver with Master: c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069)
I20260811 19:00:22.460565 2326 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:59651
I20260811 19:00:22.469576 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 19:00:22.472126 2718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.469932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39154 (local address 127.5.226.126:42441)
0811 19:00:22.469982 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:22.469983 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:22.470060 (+ 77us) server_negotiation.cc:407] Connection header received
0811 19:00:22.470130 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:22.470131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:22.470227 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:22.470291 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:00:22.470411 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.470897 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.471572 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.471744 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.471788 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.471893 (+ 105us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:00:22.471990 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:00:22.472044 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:22.472056 (+ 12us) server_negotiation.cc:299] Negotiation successful
0811 19:00:22.472073 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 19:00:22.472414 2326 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:39154:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 19:00:22.474215 2326 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 19:00:22.476390 2564 tablet_service.cc:1467] Processing CreateTablet for tablet a525e1c644aa42fe9cf50c54842c8c73 (DEFAULT_TABLE table=test-table [id=c7f4abcfbb5943a6af52ee23e61dc2fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:00:22.476584 2564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a525e1c644aa42fe9cf50c54842c8c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:22.478070 2485 tablet_bootstrap.cc:492] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5: Bootstrap starting.
I20260811 19:00:22.478391 2485 tablet_bootstrap.cc:654] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:22.478986 2485 tablet_bootstrap.cc:492] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5: No bootstrap required, opened a new log
I20260811 19:00:22.479038 2485 ts_tablet_manager.cc:1397] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 19:00:22.479144 2485 raft_consensus.cc:348] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:22.479219 2485 raft_consensus.cc:374] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:22.479264 2485 raft_consensus.cc:729] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e347ca754e46473cb650b6b3449268f5, State: Initialized, Role: FOLLOWER
I20260811 19:00:22.479310 2485 consensus_queue.cc:260] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:22.479395 2485 ts_tablet_manager.cc:1428] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:22.480166 2726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.475980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:35595 (local address 127.0.0.1:53444)
0811 19:00:22.476088 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:22.476097 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:22.476130 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:22.476568 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:22.476569 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:22.476571 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:22.476612 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.476614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.478012 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.478013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.479058 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.479061 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.479938 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.479939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.479997 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.480000 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:00:22.480052 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 19:00:22.480097 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"mutex_wait_us":1}
I20260811 19:00:22.480212 3253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.476101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53444 (local address 127.5.226.66:35595)
0811 19:00:22.476409 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:22.476413 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:22.476421 (+ 8us) server_negotiation.cc:407] Connection header received
0811 19:00:22.476454 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:22.476456 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:22.476469 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:22.476685 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:22.476750 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.477907 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.479203 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.479856 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.479923 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.479986 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:22.480081 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 19:00:22.480130 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":91,"threads_started":1}
I20260811 19:00:22.480510 3249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.476000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:45069 (local address 127.0.0.1:56082)
0811 19:00:22.476151 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:22.476160 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:22.476201 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:22.476614 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:22.476615 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:22.476617 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:22.476648 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.476649 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.478140 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.478141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.479030 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.479033 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.480302 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.480303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.480362 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.480366 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:00:22.480411 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 19:00:22.480447 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":1,"thread_start_us":100,"threads_started":1}
I20260811 19:00:22.480645 3254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.476176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56082 (local address 127.5.226.67:45069)
0811 19:00:22.476370 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:22.476375 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:22.476387 (+ 12us) server_negotiation.cc:407] Connection header received
0811 19:00:22.476430 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:22.476433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:22.476449 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:22.476536 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:22.476745 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.478040 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.479128 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.479857 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.479926 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.479986 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:22.480435 (+ 449us) server_negotiation.cc:299] Negotiation successful
0811 19:00:22.480504 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":110,"threads_started":1}
I20260811 19:00:22.480916 2855 tablet_service.cc:1467] Processing CreateTablet for tablet a525e1c644aa42fe9cf50c54842c8c73 (DEFAULT_TABLE table=test-table [id=c7f4abcfbb5943a6af52ee23e61dc2fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:00:22.481251 2855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a525e1c644aa42fe9cf50c54842c8c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:22.481230 3110 tablet_service.cc:1467] Processing CreateTablet for tablet a525e1c644aa42fe9cf50c54842c8c73 (DEFAULT_TABLE table=test-table [id=c7f4abcfbb5943a6af52ee23e61dc2fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:00:22.481541 3110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a525e1c644aa42fe9cf50c54842c8c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:22.483989 3260 tablet_bootstrap.cc:492] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483: Bootstrap starting.
I20260811 19:00:22.484148 3262 tablet_bootstrap.cc:492] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad: Bootstrap starting.
I20260811 19:00:22.484792 3260 tablet_bootstrap.cc:654] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:22.484792 3262 tablet_bootstrap.cc:654] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:22.485375 3262 log.cc:824] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:22.485422 3260 log.cc:824] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:22.486182 3262 tablet_bootstrap.cc:492] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad: No bootstrap required, opened a new log
I20260811 19:00:22.486182 3260 tablet_bootstrap.cc:492] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483: No bootstrap required, opened a new log
I20260811 19:00:22.486256 3260 ts_tablet_manager.cc:1397] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:00:22.486258 3262 ts_tablet_manager.cc:1397] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 19:00:22.488162 3260 raft_consensus.cc:348] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:22.488162 3262 raft_consensus.cc:348] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:22.488349 3262 raft_consensus.cc:374] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:22.488349 3260 raft_consensus.cc:374] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:22.488396 3260 raft_consensus.cc:729] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67c88450e2434c959eeab19fd37df483, State: Initialized, Role: FOLLOWER
I20260811 19:00:22.488396 3262 raft_consensus.cc:729] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c083f54a36254981a695dc33b42a20ad, State: Initialized, Role: FOLLOWER
I20260811 19:00:22.488518 3260 consensus_queue.cc:260] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:22.488518 3262 consensus_queue.cc:260] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:22.488806 3262 ts_tablet_manager.cc:1428] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 19:00:22.488806 3260 ts_tablet_manager.cc:1428] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 19:00:22.488863 3237 heartbeater.cc:503] Master 127.5.226.126:42441 was elected leader, sending a full tablet report...
I20260811 19:00:22.488924 2985 heartbeater.cc:503] Master 127.5.226.126:42441 was elected leader, sending a full tablet report...
I20260811 19:00:22.565680 2724 raft_consensus.cc:482] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:00:22.565827 2724 raft_consensus.cc:504] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:22.566215 2724 leader_election.cc:288] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595), c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069)
I20260811 19:00:22.569316 2714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.566399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:45069 (local address 127.5.226.65:59605)
0811 19:00:22.566459 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:22.566471 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:22.566513 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:22.566668 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:22.566669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:22.566670 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:22.567040 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.567042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.567642 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.567643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.568494 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.568496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.569058 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.569059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.569123 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.569126 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:00:22.569171 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 19:00:22.569217 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":1}
I20260811 19:00:22.569316 3254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.566491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:59605 (local address 127.5.226.67:45069)
0811 19:00:22.566540 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:22.566542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:22.566552 (+ 10us) server_negotiation.cc:407] Connection header received
0811 19:00:22.566583 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:22.566584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:22.566594 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:22.566655 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:22.567105 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.567565 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.568588 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.568979 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.569041 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.569052 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:22.569187 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 19:00:22.569227 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 19:00:22.569427 3253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.566483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:45755 (local address 127.5.226.66:35595)
0811 19:00:22.566554 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:22.566556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:22.566783 (+ 227us) server_negotiation.cc:407] Connection header received
0811 19:00:22.566851 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:22.566852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:22.566860 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:22.566899 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:22.567051 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.567526 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.568663 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.569054 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.569114 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.569122 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:22.569326 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 19:00:22.569364 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 19:00:22.569444 3274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.566410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:35595 (local address 127.5.226.65:45755)
0811 19:00:22.566711 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:22.566722 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:22.566781 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:22.566926 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:22.566927 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:22.566929 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:22.566998 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.567000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.567609 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.567611 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.568589 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:22.568592 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.569146 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.569147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:22.569235 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.569239 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:00:22.569284 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 19:00:22.569343 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":147,"thread_start_us":123,"threads_started":1}
I20260811 19:00:22.569634 3144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a525e1c644aa42fe9cf50c54842c8c73" candidate_uuid: "e347ca754e46473cb650b6b3449268f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c083f54a36254981a695dc33b42a20ad" is_pre_election: true
I20260811 19:00:22.569734 2897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a525e1c644aa42fe9cf50c54842c8c73" candidate_uuid: "e347ca754e46473cb650b6b3449268f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67c88450e2434c959eeab19fd37df483" is_pre_election: true
I20260811 19:00:22.569789 3144 raft_consensus.cc:2454] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e347ca754e46473cb650b6b3449268f5 in term 0.
I20260811 19:00:22.569880 2897 raft_consensus.cc:2454] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e347ca754e46473cb650b6b3449268f5 in term 0.
I20260811 19:00:22.570020 2471 leader_election.cc:302] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c083f54a36254981a695dc33b42a20ad, e347ca754e46473cb650b6b3449268f5; no voters:
I20260811 19:00:22.570164 2724 raft_consensus.cc:2781] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 19:00:22.570228 2724 raft_consensus.cc:482] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 19:00:22.570246 2724 raft_consensus.cc:3037] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:22.570951 2724 raft_consensus.cc:504] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:22.571064 2724 leader_election.cc:288] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 1 election: Requested vote from peers 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595), c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069)
I20260811 19:00:22.571260 3144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a525e1c644aa42fe9cf50c54842c8c73" candidate_uuid: "e347ca754e46473cb650b6b3449268f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c083f54a36254981a695dc33b42a20ad"
I20260811 19:00:22.571290 2897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a525e1c644aa42fe9cf50c54842c8c73" candidate_uuid: "e347ca754e46473cb650b6b3449268f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67c88450e2434c959eeab19fd37df483"
I20260811 19:00:22.571338 3144 raft_consensus.cc:3037] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:22.571350 2897 raft_consensus.cc:3037] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:22.572089 3144 raft_consensus.cc:2454] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e347ca754e46473cb650b6b3449268f5 in term 1.
I20260811 19:00:22.572096 2897 raft_consensus.cc:2454] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e347ca754e46473cb650b6b3449268f5 in term 1.
I20260811 19:00:22.572273 2472 leader_election.cc:302] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67c88450e2434c959eeab19fd37df483, e347ca754e46473cb650b6b3449268f5; no voters:
I20260811 19:00:22.572364 2724 raft_consensus.cc:2781] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:00:22.572516 2724 raft_consensus.cc:686] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 LEADER]: Becoming Leader. State: Replica: e347ca754e46473cb650b6b3449268f5, State: Running, Role: LEADER
I20260811 19:00:22.572584 2724 consensus_queue.cc:237] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:22.573411 2326 catalog_manager.cc:5495] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e347ca754e46473cb650b6b3449268f5 (127.5.226.65). New cstate: current_term: 1 leader_uuid: "e347ca754e46473cb650b6b3449268f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } health_report { overall_health: HEALTHY } } }
W20260811 19:00:22.573810 2986 tablet.cc:2369] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:00:22.595566 2728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.593572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58072 (local address 127.5.226.65:33927)
0811 19:00:22.593616 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:22.593618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:22.593626 (+ 8us) server_negotiation.cc:407] Connection header received
0811 19:00:22.593692 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:22.593693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:22.593710 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:22.593771 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:00:22.593864 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.594325 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.594984 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:22.595160 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:22.595211 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:22.595305 (+ 94us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:00:22.595394 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:00:22.595443 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:22.595474 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 19:00:22.595492 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 19:00:22.596980 3144 raft_consensus.cc:1261] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad [term 1 FOLLOWER]: Refusing update from remote peer e347ca754e46473cb650b6b3449268f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:00:22.596990 2897 raft_consensus.cc:1261] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483 [term 1 FOLLOWER]: Refusing update from remote peer e347ca754e46473cb650b6b3449268f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:00:22.597333 2724 consensus_queue.cc:1035] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:00:22.597481 3276 consensus_queue.cc:1035] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:00:22.600152 3287 mvcc.cc:205] Tried to move back new op lower bound from 7317400873355104256 to 7317400873257844736. Current Snapshot: MvccSnapshot[applied={T|T < 7317400873355104256}]
I20260811 19:00:22.602169 2325 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:39154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:00:22.602265 2325 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:39154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:00:22.602972 2325 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Sending DeleteTablet for 3 replicas of tablet a525e1c644aa42fe9cf50c54842c8c73
I20260811 19:00:22.603338 2855 tablet_service.cc:1514] Processing DeleteTablet for tablet a525e1c644aa42fe9cf50c54842c8c73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:00:22 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:53444
I20260811 19:00:22.603343 3110 tablet_service.cc:1514] Processing DeleteTablet for tablet a525e1c644aa42fe9cf50c54842c8c73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:00:22 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:56082
I20260811 19:00:22.603535 2564 tablet_service.cc:1514] Processing DeleteTablet for tablet a525e1c644aa42fe9cf50c54842c8c73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:00:22 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:58068
I20260811 19:00:22.603574 3305 tablet_replica.cc:330] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483: stopping tablet replica
I20260811 19:00:22.603632 2729 tablet_replica.cc:330] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5: stopping tablet replica
I20260811 19:00:22.603659 3305 raft_consensus.cc:2229] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:00:22.603694 2729 raft_consensus.cc:2229] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 19:00:22.603753 3305 raft_consensus.cc:2258] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:00:22.603781 2729 raft_consensus.cc:2258] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:00:22.603928 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 2392
I20260811 19:00:22.614775 3305 ts_tablet_manager.cc:1905] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:00:22.617079 3305 ts_tablet_manager.cc:1918] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:00:22.617172 3305 log.cc:1196] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/a525e1c644aa42fe9cf50c54842c8c73
I20260811 19:00:22.617605 3305 ts_tablet_manager.cc:1939] T a525e1c644aa42fe9cf50c54842c8c73 P 67c88450e2434c959eeab19fd37df483: Deleting consensus metadata
I20260811 19:00:22.622901 3306 tablet_replica.cc:330] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad: stopping tablet replica
I20260811 19:00:22.623046 3306 raft_consensus.cc:2229] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:00:22.623158 2292 catalog_manager.cc:4841] TS 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595): tablet a525e1c644aa42fe9cf50c54842c8c73 (table test-table [id=c7f4abcfbb5943a6af52ee23e61dc2fe]) successfully deleted
I20260811 19:00:22.623241 3306 raft_consensus.cc:2258] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:00:22.624625 3306 ts_tablet_manager.cc:1905] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:00:22.626055 3306 ts_tablet_manager.cc:1918] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:00:22.626118 3306 log.cc:1196] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/a525e1c644aa42fe9cf50c54842c8c73
I20260811 19:00:22.626338 3306 ts_tablet_manager.cc:1939] T a525e1c644aa42fe9cf50c54842c8c73 P c083f54a36254981a695dc33b42a20ad: Deleting consensus metadata
I20260811 19:00:22.626755 2288 catalog_manager.cc:4841] TS c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069): tablet a525e1c644aa42fe9cf50c54842c8c73 (table test-table [id=c7f4abcfbb5943a6af52ee23e61dc2fe]) successfully deleted
W20260811 19:00:22.628798 2292 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:33927 (error 108)
I20260811 19:00:22.629170 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 2725
I20260811 19:00:22.629280 3249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:22.629161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:33927 (local address 127.0.0.1:58076)
0811 19:00:22.629213 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:22.629248 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:33927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 19:00:22.631233 2292 catalog_manager.cc:4584] TS e347ca754e46473cb650b6b3449268f5 (127.5.226.65:33927): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a525e1c644aa42fe9cf50c54842c8c73: Network error: Client connection negotiation failed: client connection to 127.5.226.65:33927: connect: Connection refused (error 111)
I20260811 19:00:22.640342 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 2988
I20260811 19:00:22.655447 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 2253
I20260811 19:00:22.667279 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:42441
--webserver_interface=127.5.226.126
--webserver_port=42971
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:42441
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:22.748020 3310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:22.748219 3310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:22.748240 3310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:22.749406 3310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:00:22.749449 3310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:22.749461 3310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:22.749472 3310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:00:22.749483 3310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:00:22.750955 3310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:42441
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:42441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=42971
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:22.751219 3310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:22.751453 3310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:22.756152 3321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:22.756201 3326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:22.756148 3322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:22.756417 3310 server_base.cc:1034] running on GCE node
I20260811 19:00:22.756661 3310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:22.756968 3310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:22.758122 3310 hybrid_clock.cc:648] HybridClock initialized: now 1786474822758100 us; error 36 us; skew 500 ppm
Aug 11 19:00:22 dist-test-slave-gjw7 krb5kdc[1138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474822, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:22.760624 3310 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:00:22.761093 3310 webserver.cc:460] Webserver started at http://127.5.226.126:42971/ using document root <none> and password file <none>
I20260811 19:00:22.761345 3310 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:22.761401 3310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:22.762771 3310 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 19:00:22.763389 3345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:22.763547 3310 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:00:22.763651 3310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "1e3bb43510ac4fd2bfbb676317741b8b"
format_stamp: "Formatted at 2026-08-11 19:00:20 on dist-test-slave-gjw7"
server_key: "0da0f8ef1b4c255c5f6ef0c37aee37af"
server_key_iv: "0fc465415ba699c21dce83ca5a276be3"
server_key_version: "encryptionkey@0"
I20260811 19:00:22.764010 3310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:22.780145 3310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:22.782704 3310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:22.782852 3310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:22.786801 3310 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:42441
I20260811 19:00:22.786849 3450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:42441 every 8 connection(s)
I20260811 19:00:22.787194 3310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:00:22.788720 3455 sys_catalog.cc:263] Verifying existing consensus state
I20260811 19:00:22.789409 3455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Bootstrap starting.
I20260811 19:00:22.792181 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 3310
I20260811 19:00:22.792500 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:33927
--local_ip_for_outbound_sockets=127.5.226.65
--tserver_master_addrs=127.5.226.126:42441
--webserver_port=41119
--webserver_interface=127.5.226.65
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:00:22.798594 3455 log.cc:824] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:22.800801 3455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 19:00:22.801066 3455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b: Bootstrap complete.
I20260811 19:00:22.803225 3455 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } }
I20260811 19:00:22.803443 3455 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3bb43510ac4fd2bfbb676317741b8b, State: Initialized, Role: FOLLOWER
I20260811 19:00:22.803597 3455 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } }
I20260811 19:00:22.803660 3455 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:00:22.803701 3455 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:00:22.803746 3455 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 2 FOLLOWER]: Advancing to term 3
I20260811 19:00:22.804706 3455 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } }
I20260811 19:00:22.804808 3455 leader_election.cc:302] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e3bb43510ac4fd2bfbb676317741b8b; no voters:
I20260811 19:00:22.804968 3455 leader_election.cc:288] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 19:00:22.805023 3467 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 3 FOLLOWER]: Leader election won for term 3
I20260811 19:00:22.805140 3467 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [term 3 LEADER]: Becoming Leader. State: Replica: 1e3bb43510ac4fd2bfbb676317741b8b, State: Running, Role: LEADER
I20260811 19:00:22.805240 3455 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:00:22.805330 3467 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } }
I20260811 19:00:22.805610 3467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e3bb43510ac4fd2bfbb676317741b8b. Latest consensus state: current_term: 3 leader_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } } }
I20260811 19:00:22.805682 3467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:22.805676 3469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3bb43510ac4fd2bfbb676317741b8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 42441 } } }
I20260811 19:00:22.805852 3469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3bb43510ac4fd2bfbb676317741b8b [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:22.805991 3475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:00:22.806784 3475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:00:22.806991 3475 catalog_manager.cc:1259] Loaded cluster ID: 6addc990b95b485998bd15f3521d6cd4
I20260811 19:00:22.807125 3475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 19:00:22.811492 3475 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2a4f62f9ad google::LogMessage::Fail() at ??:0
@ 0x7f2a4f63288a google::LogMessage::SendToLog() at ??:0
@ 0x7f2a4f62f4de google::LogMessage::Flush() at ??:0
@ 0x7f2a4f630a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2a575500f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f2a575598b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2a514fd0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2a514f2954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2a523566db start_thread at ??:0
@ 0x7f2a4e12d61f clone at ??:0
W20260811 19:00:22.884532 3460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:22.884725 3460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:22.884758 3460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:22.885942 3460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:22.885985 3460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:22.886019 3460 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 19:00:22.887478 3460 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:33927
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=41119
--tserver_master_addrs=127.5.226.126:42441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3460
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:22.887707 3460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:22.887940 3460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:22.893919 3521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:22.893957 3523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:22.894152 3527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:22.894290 3460 server_base.cc:1034] running on GCE node
I20260811 19:00:22.894493 3460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:22.894747 3460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:22.895915 3460 hybrid_clock.cc:648] HybridClock initialized: now 1786474822895899 us; error 31 us; skew 500 ppm
Aug 11 19:00:22 dist-test-slave-gjw7 krb5kdc[1138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474822, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:22.898561 3460 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 19:00:22.899022 3460 webserver.cc:460] Webserver started at http://127.5.226.65:41119/ using document root <none> and password file <none>
I20260811 19:00:22.899251 3460 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:22.899305 3460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:22.900645 3460 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:00:22.901342 3554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:22.901536 3460 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 19:00:22.901625 3460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "e347ca754e46473cb650b6b3449268f5"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "95ae94652c2a8ec459b7f59b08e3f3e2"
server_key_iv: "5d1e4003c8a298301c3a8f6836e905b2"
server_key_version: "encryptionkey@0"
I20260811 19:00:22.901975 3460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:22.922778 3460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:22.925004 3460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:22.925150 3460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:22.925415 3460 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:22.925902 3566 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 19:00:22.927917 3460 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 19:00:22.927964 3460 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 19:00:22.927999 3460 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 19:00:22.928632 3460 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 19:00:22.928664 3460 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 19:00:22.928761 3566 tablet_bootstrap.cc:492] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5: Bootstrap starting.
I20260811 19:00:22.935556 3460 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:33927
I20260811 19:00:22.935688 3756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:33927 every 8 connection(s)
I20260811 19:00:22.936004 3460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 19:00:22.938681 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 3460
I20260811 19:00:22.938959 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:35595
--local_ip_for_outbound_sockets=127.5.226.66
--tserver_master_addrs=127.5.226.126:42441
--webserver_port=33137
--webserver_interface=127.5.226.66
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:00:22.940567 3566 log.cc:824] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:22.943382 3566 tablet_bootstrap.cc:492] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 19:00:22.943706 3566 tablet_bootstrap.cc:492] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5: Bootstrap complete.
I20260811 19:00:22.944959 3566 ts_tablet_manager.cc:1397] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.005s
I20260811 19:00:22.946439 3566 raft_consensus.cc:348] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:22.946800 3566 raft_consensus.cc:729] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e347ca754e46473cb650b6b3449268f5, State: Initialized, Role: FOLLOWER
I20260811 19:00:22.946976 3566 consensus_queue.cc:260] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:22.947274 3566 ts_tablet_manager.cc:1428] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5: Time spent starting tablet: real 0.002s user 0.006s sys 0.000s
W20260811 19:00:23.013501 3767 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:00:22.936710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:47559)
0811 19:00:22.936886 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:22.936923 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:22.937427 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:23.013251 (+ 75824us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":99,"threads_started":1}
W20260811 19:00:23.013768 3757 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:42441 (0 consecutive failures): Network error: Failed to ping master at 127.5.226.126:42441: Client connection negotiation failed: client connection to 127.5.226.126:42441: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 19:00:23.014117 3767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:23.014008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:60555)
0811 19:00:23.014058 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:23.014096 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 19:00:23.014453 3767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:23.014386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:35085)
0811 19:00:23.014417 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:23.014439 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 19:00:23.014557 3757 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 19:00:23.028333 3768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:23.028541 3768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:23.028563 3768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:23.029752 3768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:23.029793 3768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:23.029817 3768 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 19:00:23.031338 3768 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:35595
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=33137
--tserver_master_addrs=127.5.226.126:42441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:23.031546 3768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:23.031731 3768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 19:00:23.036659 3768 server_base.cc:1034] running on GCE node
W20260811 19:00:23.036633 3776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:23.036643 3781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:23.038964 3778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:23.039175 3768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:23.039426 3768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:23.040589 3768 hybrid_clock.cc:648] HybridClock initialized: now 1786474823040576 us; error 32 us; skew 500 ppm
Aug 11 19:00:23 dist-test-slave-gjw7 krb5kdc[1138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474823, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:23.043093 3768 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 19:00:23.043504 3768 webserver.cc:460] Webserver started at http://127.5.226.66:33137/ using document root <none> and password file <none>
I20260811 19:00:23.043697 3768 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:23.043740 3768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:23.045047 3768 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:00:23.045696 3799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:23.045854 3768 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:23.045950 3768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "67c88450e2434c959eeab19fd37df483"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "f37255ca833bed206e414cb56f2f80a6"
server_key_iv: "2283a3e8a9e08e55b78439a49a4a89b8"
server_key_version: "encryptionkey@0"
I20260811 19:00:23.046350 3768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:23.059657 3768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:23.061915 3768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:23.062028 3768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:23.062229 3768 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:23.062544 3768 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:23.062578 3768 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:23.062599 3768 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:23.062621 3768 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:23.068418 3768 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:35595
I20260811 19:00:23.068497 4039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:35595 every 8 connection(s)
I20260811 19:00:23.068794 3768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 19:00:23.069813 4042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:23.069446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:50177)
0811 19:00:23.069597 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:23.069666 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260811 19:00:23.070053 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 3768
I20260811 19:00:23.070284 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:45069
--local_ip_for_outbound_sockets=127.5.226.67
--tserver_master_addrs=127.5.226.126:42441
--webserver_port=40967
--webserver_interface=127.5.226.67
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:23.072041 4040 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:42441 (0 consecutive failures): Network error: Failed to ping master at 127.5.226.126:42441: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
I20260811 19:00:23.072372 4042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:23.072274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:49187)
0811 19:00:23.072322 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:23.072351 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 19:00:23.072645 4042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:23.072575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:47599)
0811 19:00:23.072610 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:23.072630 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 19:00:23.072752 4040 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 19:00:23.154511 4043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:23.154727 4043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:23.154760 4043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:23.155933 4043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:23.156091 4043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:23.156144 4043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 19:00:23.157862 4043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:45069
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=40967
--tserver_master_addrs=127.5.226.126:42441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:23.158102 4043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:23.158315 4043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:23.163166 4053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:23.163332 4043 server_base.cc:1034] running on GCE node
W20260811 19:00:23.163190 4058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:23.163173 4052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:23.163604 4043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:23.163815 4043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:23.164958 4043 hybrid_clock.cc:648] HybridClock initialized: now 1786474823164947 us; error 26 us; skew 500 ppm
Aug 11 19:00:23 dist-test-slave-gjw7 krb5kdc[1138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474823, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:23.167407 4043 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 19:00:23.167804 4043 webserver.cc:460] Webserver started at http://127.5.226.67:40967/ using document root <none> and password file <none>
I20260811 19:00:23.167994 4043 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:23.168041 4043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:23.169344 4043 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:00:23.169894 4079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:23.170038 4043 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:23.170122 4043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "c083f54a36254981a695dc33b42a20ad"
format_stamp: "Formatted at 2026-08-11 19:00:21 on dist-test-slave-gjw7"
server_key: "57549c0fc7dc6a0776bcf197c6e2a178"
server_key_iv: "def58d1dbcdd1ad3735d8eea17ffcc24"
server_key_version: "encryptionkey@0"
I20260811 19:00:23.170483 4043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:23.181314 4043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:23.183454 4043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:23.183604 4043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:23.183847 4043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:23.184201 4043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:23.184247 4043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:23.184283 4043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:23.184299 4043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:23.190130 4043 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:45069
I20260811 19:00:23.190196 4302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:45069 every 8 connection(s)
I20260811 19:00:23.190521 4043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 19:00:23.191586 4309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:23.191164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:60983)
0811 19:00:23.191370 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:23.191445 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":121,"threads_started":1}
W20260811 19:00:23.191975 4304 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:42441 (0 consecutive failures): Network error: Failed to ping master at 127.5.226.126:42441: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
I20260811 19:00:23.192289 4309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:23.192141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:51523)
0811 19:00:23.192233 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:23.192266 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 19:00:23.192664 4309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:23.192573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:57731)
0811 19:00:23.192621 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:23.192647 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 19:00:23.192804 4304 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 19:00:23.196502 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 4043
I20260811 19:00:24.015216 4312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:24.014964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:48887)
0811 19:00:24.015094 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:24.015139 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":68,"threads_started":1}
I20260811 19:00:24.073323 4314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:24.073028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:54173)
0811 19:00:24.073171 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:24.073234 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":62,"threads_started":1}
I20260811 19:00:24.193351 4316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:24.193115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:52959)
0811 19:00:24.193244 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:24.193281 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":59,"threads_started":1}
I20260811 19:00:24.241432 4319 raft_consensus.cc:482] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:00:24.241565 4319 raft_consensus.cc:504] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:24.241887 4319 leader_election.cc:288] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595), c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069)
Aug 11 19:00:24 dist-test-slave-gjw7 krb5kdc[1138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474822, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.66@KRBTEST.COM
Aug 11 19:00:24 dist-test-slave-gjw7 krb5kdc[1138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474822, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.67@KRBTEST.COM
I20260811 19:00:24.252367 4322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:24.242214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:47129 (local address 127.5.226.67:45069)
0811 19:00:24.242362 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:24.242375 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:24.242409 (+ 34us) server_negotiation.cc:407] Connection header received
0811 19:00:24.242861 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:24.242863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:24.242905 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:24.243036 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:24.243847 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:24.244704 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:24.245748 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:24.246139 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:24.246245 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:24.248954 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:24.248959 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:24.248959 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:24.248972 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:24.250933 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:24.251276 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:24.251279 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:24.251279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:24.251397 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:24.251590 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:24.251590 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:24.251591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:24.251811 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:24.251891 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:24.252108 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 19:00:24.252262 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
I20260811 19:00:24.252377 4324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:24.242295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:33175 (local address 127.5.226.66:35595)
0811 19:00:24.242435 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:24.242443 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:24.242471 (+ 28us) server_negotiation.cc:407] Connection header received
0811 19:00:24.242886 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:24.242889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:24.242925 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:24.243048 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:24.243850 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:24.244700 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:24.245750 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:24.246138 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:24.246245 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:24.248667 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:24.248672 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:24.248673 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:24.248685 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:24.250643 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:24.251099 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:24.251103 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:24.251103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:24.251221 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:24.251478 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:24.251478 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:24.251479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:24.251755 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:24.251817 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:24.252113 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 19:00:24.252280 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260811 19:00:24.252364 4321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:24.242079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:45069 (local address 127.5.226.65:47129)
0811 19:00:24.242216 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:24.242226 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:24.242274 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:24.243105 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:24.243108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:24.243524 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:24.243729 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:24.243735 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:24.244804 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:24.244805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:24.245655 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:24.245658 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:24.246224 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:24.246225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:24.246350 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:24.246919 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:24.246923 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:24.248834 (+ 1911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:24.251006 (+ 2172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:24.251007 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:24.251007 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:24.251199 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:24.251467 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:24.251468 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:24.251468 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:24.251533 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:24.251880 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:24.251881 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:24.251955 (+ 74us) client_negotiation.cc:769] Sending connection context
0811 19:00:24.252044 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 19:00:24.252234 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":50,"thread_start_us":91,"threads_started":1}
I20260811 19:00:24.252439 4312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:24.242051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:35595 (local address 127.5.226.65:33175)
0811 19:00:24.242112 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:24.242123 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:24.242180 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:24.243105 (+ 925us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:24.243108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:24.243522 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:24.243729 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:24.243735 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:24.244799 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:24.244800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:24.245656 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:24.245659 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:24.246230 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:24.246231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:24.246349 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:24.246874 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:24.246882 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:24.248400 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:24.250737 (+ 2337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:24.250745 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:24.250747 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:24.251019 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:24.251281 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:24.251282 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:24.251282 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:24.251419 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:24.251821 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:24.251828 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:24.251960 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 19:00:24.252044 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 19:00:24.252310 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":183}
W20260811 19:00:24.253312 3561 leader_election.cc:341] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595): Not found: Tablet not found: a525e1c644aa42fe9cf50c54842c8c73
W20260811 19:00:24.253386 3558 leader_election.cc:341] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069): Not found: Tablet not found: a525e1c644aa42fe9cf50c54842c8c73
I20260811 19:00:24.253464 3558 leader_election.cc:302] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e347ca754e46473cb650b6b3449268f5; no voters: 67c88450e2434c959eeab19fd37df483, c083f54a36254981a695dc33b42a20ad
I20260811 19:00:24.253572 4319 raft_consensus.cc:2726] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 19:00:25.015928 4331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:25.015667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:32861)
0811 19:00:25.015818 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:25.015861 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":67,"threads_started":1}
I20260811 19:00:25.073920 4332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:25.073709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:34381)
0811 19:00:25.073840 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:25.073878 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":70,"threads_started":1}
I20260811 19:00:25.193917 4334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:25.193712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:42477)
0811 19:00:25.193840 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:25.193878 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":59,"threads_started":1}
I20260811 19:00:26.016626 4336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:26.016383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:38297)
0811 19:00:26.016540 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:26.016580 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":84,"threads_started":1}
I20260811 19:00:26.074587 4337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:26.074362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:42793)
0811 19:00:26.074499 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:26.074537 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":82,"threads_started":1}
I20260811 19:00:26.110051 4340 raft_consensus.cc:482] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:00:26.110150 4340 raft_consensus.cc:504] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:26.110294 4340 leader_election.cc:288] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595), c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069)
W20260811 19:00:26.110723 3561 leader_election.cc:341] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595): Not found: Tablet not found: a525e1c644aa42fe9cf50c54842c8c73
W20260811 19:00:26.110795 3558 leader_election.cc:341] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069): Not found: Tablet not found: a525e1c644aa42fe9cf50c54842c8c73
I20260811 19:00:26.110880 3558 leader_election.cc:302] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e347ca754e46473cb650b6b3449268f5; no voters: 67c88450e2434c959eeab19fd37df483, c083f54a36254981a695dc33b42a20ad
I20260811 19:00:26.110950 4340 raft_consensus.cc:2726] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 19:00:26.194550 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:26.194349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:34841)
0811 19:00:26.194480 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:26.194513 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
I20260811 19:00:27.017450 4343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:27.017155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:47015)
0811 19:00:27.017349 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:27.017397 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":70,"threads_started":1}
I20260811 19:00:27.075253 4344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:27.075032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:37981)
0811 19:00:27.075170 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:27.075208 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
I20260811 19:00:27.195230 4349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:27.195009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:34253)
0811 19:00:27.195153 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:27.195189 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":90,"threads_started":1}
I20260811 19:00:28.018136 4352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:28.017921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:38821)
0811 19:00:28.018047 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:28.018086 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":67,"threads_started":1}
I20260811 19:00:28.075937 4354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:28.075684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:60149)
0811 19:00:28.075832 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:28.075874 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":82,"threads_started":1}
I20260811 19:00:28.195904 4355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:28.195664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:48849)
0811 19:00:28.195810 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:28.195848 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
I20260811 19:00:29.018828 4356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:29.018593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:38475)
0811 19:00:29.018738 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:29.018777 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":85,"threads_started":1}
I20260811 19:00:29.076538 4357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:29.076333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:34123)
0811 19:00:29.076464 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:29.076498 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":80,"threads_started":1}
I20260811 19:00:29.196527 4358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:29.196328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:43267)
0811 19:00:29.196449 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:29.196485 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":65,"threads_started":1}
I20260811 19:00:29.247797 4359 raft_consensus.cc:482] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:00:29.247895 4359 raft_consensus.cc:504] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:29.248070 4359 leader_election.cc:288] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595), c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069)
W20260811 19:00:29.248441 3561 leader_election.cc:341] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595): Not found: Tablet not found: a525e1c644aa42fe9cf50c54842c8c73
W20260811 19:00:29.248541 3558 leader_election.cc:341] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069): Not found: Tablet not found: a525e1c644aa42fe9cf50c54842c8c73
I20260811 19:00:29.248584 3558 leader_election.cc:302] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e347ca754e46473cb650b6b3449268f5; no voters: 67c88450e2434c959eeab19fd37df483, c083f54a36254981a695dc33b42a20ad
I20260811 19:00:29.248649 4359 raft_consensus.cc:2726] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 19:00:30.019614 4364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:30.019350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:41981)
0811 19:00:30.019509 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:30.019563 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":72,"threads_started":1}
I20260811 19:00:30.077232 4367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:30.076971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:47395)
0811 19:00:30.077137 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:30.077176 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":85,"threads_started":1}
I20260811 19:00:30.197221 4369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:30.196967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:48443)
0811 19:00:30.197129 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:30.197176 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":65,"threads_started":1}
I20260811 19:00:31.020354 4373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:31.020123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:60341)
0811 19:00:31.020256 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:31.020303 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":82,"threads_started":1}
I20260811 19:00:31.077958 4375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:31.077695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:45165)
0811 19:00:31.077866 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:31.077911 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":91,"threads_started":1}
I20260811 19:00:31.197892 4377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:31.197686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:32909)
0811 19:00:31.197805 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:31.197846 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":62,"threads_started":1}
I20260811 19:00:32.020996 4378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:32.020750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:51079)
0811 19:00:32.020903 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:32.020946 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":73,"threads_started":1}
I20260811 19:00:32.078552 4379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:32.078361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:55607)
0811 19:00:32.078471 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:32.078507 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":60,"threads_started":1}
I20260811 19:00:32.198557 4381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:32.198322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:44247)
0811 19:00:32.198468 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:32.198509 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":81,"threads_started":1}
I20260811 19:00:33.006510 4384 raft_consensus.cc:482] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:00:33.006614 4384 raft_consensus.cc:504] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:33.006803 4384 leader_election.cc:288] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595), c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069)
W20260811 19:00:33.007216 3561 leader_election.cc:341] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595): Not found: Tablet not found: a525e1c644aa42fe9cf50c54842c8c73
W20260811 19:00:33.007351 3558 leader_election.cc:341] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069): Not found: Tablet not found: a525e1c644aa42fe9cf50c54842c8c73
I20260811 19:00:33.007437 3558 leader_election.cc:302] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e347ca754e46473cb650b6b3449268f5; no voters: 67c88450e2434c959eeab19fd37df483, c083f54a36254981a695dc33b42a20ad
I20260811 19:00:33.007534 4384 raft_consensus.cc:2726] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 19:00:33.021667 4385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:33.021469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:46789)
0811 19:00:33.021586 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:33.021621 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":61,"threads_started":1}
I20260811 19:00:33.079172 4389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:33.078964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:37639)
0811 19:00:33.079082 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:33.079124 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260811 19:00:33.199303 4392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:33.199064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:52303)
0811 19:00:33.199206 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:33.199241 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
I20260811 19:00:34.022308 4394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:34.022056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:44487)
0811 19:00:34.022218 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:34.022258 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":66,"threads_started":1}
I20260811 19:00:34.079825 4397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:34.079613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:41471)
0811 19:00:34.079746 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:34.079782 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
I20260811 19:00:34.199950 4398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:34.199738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:54011)
0811 19:00:34.199858 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:34.199901 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":69,"threads_started":1}
I20260811 19:00:35.023053 4399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:35.022738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:57541)
0811 19:00:35.022949 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:35.022999 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":107,"threads_started":1}
I20260811 19:00:35.080482 4400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:35.080259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:57765)
0811 19:00:35.080392 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:35.080427 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260811 19:00:35.200615 4402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:35.200381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:57683)
0811 19:00:35.200522 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:35.200563 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":67,"threads_started":1}
I20260811 19:00:36.023940 4403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:36.023653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:47657)
0811 19:00:36.023834 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:36.023879 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":89,"threads_started":1}
I20260811 19:00:36.081141 4405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:36.080934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:41655)
0811 19:00:36.081059 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:36.081095 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":73,"threads_started":1}
I20260811 19:00:36.201323 4406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:36.201062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:60089)
0811 19:00:36.201202 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:36.201248 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":64,"threads_started":1}
I20260811 19:00:36.311708 4407 raft_consensus.cc:482] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:00:36.311808 4407 raft_consensus.cc:504] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67c88450e2434c959eeab19fd37df483" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 35595 } } peers { permanent_uuid: "c083f54a36254981a695dc33b42a20ad" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 45069 } } peers { permanent_uuid: "e347ca754e46473cb650b6b3449268f5" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 33927 } }
I20260811 19:00:36.311978 4407 leader_election.cc:288] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595), c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069)
W20260811 19:00:36.312353 3558 leader_election.cc:341] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c083f54a36254981a695dc33b42a20ad (127.5.226.67:45069): Not found: Tablet not found: a525e1c644aa42fe9cf50c54842c8c73
W20260811 19:00:36.312443 3561 leader_election.cc:341] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67c88450e2434c959eeab19fd37df483 (127.5.226.66:35595): Not found: Tablet not found: a525e1c644aa42fe9cf50c54842c8c73
I20260811 19:00:36.312484 3561 leader_election.cc:302] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e347ca754e46473cb650b6b3449268f5; no voters: 67c88450e2434c959eeab19fd37df483, c083f54a36254981a695dc33b42a20ad
I20260811 19:00:36.312554 4407 raft_consensus.cc:2726] T a525e1c644aa42fe9cf50c54842c8c73 P e347ca754e46473cb650b6b3449268f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 19:00:37.024679 4412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:37.024448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:54689)
0811 19:00:37.024581 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:37.024625 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":68,"threads_started":1}
I20260811 19:00:37.081856 4415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:37.081607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:44013)
0811 19:00:37.081745 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:37.081797 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
I20260811 19:00:37.201972 4417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:37.201765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:55787)
0811 19:00:37.201882 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:37.201922 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":63,"threads_started":1}
I20260811 19:00:38.025544 4418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:38.025336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.65:56615)
0811 19:00:38.025461 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:38.025496 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":61,"threads_started":1}
I20260811 19:00:38.082564 4419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:38.082346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.66:53899)
0811 19:00:38.082476 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:38.082518 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
I20260811 19:00:38.199899 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 3460
I20260811 19:00:38.205910 4420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:38.205703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:42441 (local address 127.5.226.67:47789)
0811 19:00:38.205822 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:38.205857 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:42441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":51,"threads_started":1}
I20260811 19:00:38.213447 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 3768
I20260811 19:00:38.228626 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 4043
2026-08-11T19:00:38Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18747 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:00:38 dist-test-slave-gjw7 krb5kdc[4426](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:00:38 dist-test-slave-gjw7 krb5kdc[4426](info): set up 2 sockets
Aug 11 19:00:38 dist-test-slave-gjw7 krb5kdc[4426](info): commencing operation
krb5kdc: starting...
W20260811 19:00:39.442827 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:00:39 dist-test-slave-gjw7 krb5kdc[4426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474839, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:00:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:00:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:00:39.559689 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:35241
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:35241
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:39.642817 4455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:39.643038 4455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:39.643069 4455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:39.644220 4455 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 19:00:39.644260 4455 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 19:00:39.644277 4455 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 19:00:39.644291 4455 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:00:39.644308 4455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:39.644335 4455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:39.644359 4455 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:00:39.644381 4455 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:00:39.646025 4455 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:35241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:35241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:39.646296 4455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:39.646503 4455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:39.651638 4467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:39.651686 4455 server_base.cc:1034] running on GCE node
W20260811 19:00:39.651652 4464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:39.651633 4470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:39.652077 4455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:39.652364 4455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:39.653496 4455 hybrid_clock.cc:648] HybridClock initialized: now 1786474839653484 us; error 27 us; skew 500 ppm
Aug 11 19:00:39 dist-test-slave-gjw7 krb5kdc[4426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474839, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:39.656123 4455 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:00:39.656590 4455 webserver.cc:460] Webserver started at http://127.5.226.126:44813/ using document root <none> and password file <none>
I20260811 19:00:39.656807 4455 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:39.656854 4455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:39.656976 4455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:39.658033 4455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "bfba7b47f08f4cb19a05028b8cf27957"
format_stamp: "Formatted at 2026-08-11 19:00:39 on dist-test-slave-gjw7"
server_key: "6202a4cfe0247cd2a6834e62a0fdd930"
server_key_iv: "fa7e664c223dfccdffb0704f6e006cfc"
server_key_version: "encryptionkey@0"
I20260811 19:00:39.658375 4455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "bfba7b47f08f4cb19a05028b8cf27957"
format_stamp: "Formatted at 2026-08-11 19:00:39 on dist-test-slave-gjw7"
server_key: "6202a4cfe0247cd2a6834e62a0fdd930"
server_key_iv: "fa7e664c223dfccdffb0704f6e006cfc"
server_key_version: "encryptionkey@0"
I20260811 19:00:39.659621 4455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 19:00:39.660302 4489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:39.660449 4455 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:00:39.660532 4455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "bfba7b47f08f4cb19a05028b8cf27957"
format_stamp: "Formatted at 2026-08-11 19:00:39 on dist-test-slave-gjw7"
server_key: "6202a4cfe0247cd2a6834e62a0fdd930"
server_key_iv: "fa7e664c223dfccdffb0704f6e006cfc"
server_key_version: "encryptionkey@0"
I20260811 19:00:39.660600 4455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:39.688619 4455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:39.690528 4455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:39.690642 4455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:39.694669 4455 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:35241
I20260811 19:00:39.694707 4601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:35241 every 8 connection(s)
I20260811 19:00:39.695055 4455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:00:39.695916 4602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:39.698278 4602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Bootstrap starting.
I20260811 19:00:39.698868 4602 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:39.699144 4602 log.cc:824] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:39.699779 4602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: No bootstrap required, opened a new log
I20260811 19:00:39.701447 4602 raft_consensus.cc:348] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } }
I20260811 19:00:39.701591 4602 raft_consensus.cc:374] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:39.701623 4602 raft_consensus.cc:729] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfba7b47f08f4cb19a05028b8cf27957, State: Initialized, Role: FOLLOWER
I20260811 19:00:39.701767 4602 consensus_queue.cc:260] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } }
I20260811 19:00:39.701831 4602 raft_consensus.cc:388] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:00:39.701855 4602 raft_consensus.cc:482] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:00:39.701902 4602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:39.702415 4602 raft_consensus.cc:504] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } }
I20260811 19:00:39.702512 4602 leader_election.cc:302] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bfba7b47f08f4cb19a05028b8cf27957; no voters:
I20260811 19:00:39.702674 4602 leader_election.cc:288] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:00:39.702710 4608 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:00:39.702853 4608 raft_consensus.cc:686] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 1 LEADER]: Becoming Leader. State: Replica: bfba7b47f08f4cb19a05028b8cf27957, State: Running, Role: LEADER
I20260811 19:00:39.702937 4602 sys_catalog.cc:564] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:00:39.702948 4608 consensus_queue.cc:237] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } }
I20260811 19:00:39.703663 4609 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bfba7b47f08f4cb19a05028b8cf27957" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } } }
I20260811 19:00:39.703703 4610 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bfba7b47f08f4cb19a05028b8cf27957. Latest consensus state: current_term: 1 leader_uuid: "bfba7b47f08f4cb19a05028b8cf27957" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } } }
I20260811 19:00:39.703832 4609 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:39.703848 4610 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:39.704257 4625 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:00:39.705091 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 4455
I20260811 19:00:39.705195 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:00:39.705469 6025 external_mini_cluster.cc:1428] Setting key 48288ee5ca0e56f88ca964488ad7f31a
I20260811 19:00:39.704826 4625 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:00:39.707157 4625 catalog_manager.cc:1347] Generated new cluster ID: c5f69f4cd5e349988e9282b875e03620
I20260811 19:00:39.707203 4625 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 19:00:39 dist-test-slave-gjw7 krb5kdc[4426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474839, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:39.716843 4644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:39.705904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47596 (local address 127.5.226.126:35241)
0811 19:00:39.706249 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:39.706257 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:39.706286 (+ 29us) server_negotiation.cc:407] Connection header received
0811 19:00:39.706404 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:39.706412 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:39.706466 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:39.706600 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:39.707418 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:39.708792 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:39.709900 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:39.710490 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:39.710590 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:39.713357 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:39.713362 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:39.713362 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:39.713375 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:39.715280 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:39.715629 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:39.715631 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:39.715632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:39.715747 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:39.715926 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:39.715927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:39.715928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:39.716240 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:39.716378 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:39.716455 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 19:00:39.716592 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":86,"threads_started":1}
I20260811 19:00:39.725219 4625 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:00:39.725767 4625 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:00:39.728225 4625 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Generated new TSK 0
I20260811 19:00:39.728389 4625 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 19:00:39.757097 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35241
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:39.839284 4649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:39.839494 4649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:39.839524 4649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:39.840651 4649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:39.840693 4649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:39.840726 4649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 19:00:39.842270 4649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:39.842530 4649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:39.842749 4649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:39.847663 4662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:39.847697 4667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:39.847663 4661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:39.847925 4649 server_base.cc:1034] running on GCE node
I20260811 19:00:39.848137 4649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:39.848345 4649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:39.849476 4649 hybrid_clock.cc:648] HybridClock initialized: now 1786474839849465 us; error 28 us; skew 500 ppm
Aug 11 19:00:39 dist-test-slave-gjw7 krb5kdc[4426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474839, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:39.851861 4649 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 19:00:39.852311 4649 webserver.cc:460] Webserver started at http://127.5.226.65:44693/ using document root <none> and password file <none>
I20260811 19:00:39.852524 4649 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:39.852571 4649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:39.852702 4649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:39.853765 4649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "22b89e4c494f4616b084b3e69e731b44"
format_stamp: "Formatted at 2026-08-11 19:00:39 on dist-test-slave-gjw7"
server_key: "15233f9556a0b57b5ee869742ccb5cdd"
server_key_iv: "45da89f7371ba4b7563bf1343c23506f"
server_key_version: "encryptionkey@0"
I20260811 19:00:39.854096 4649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "22b89e4c494f4616b084b3e69e731b44"
format_stamp: "Formatted at 2026-08-11 19:00:39 on dist-test-slave-gjw7"
server_key: "15233f9556a0b57b5ee869742ccb5cdd"
server_key_iv: "45da89f7371ba4b7563bf1343c23506f"
server_key_version: "encryptionkey@0"
I20260811 19:00:39.855348 4649 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:00:39.856043 4679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:39.856194 4649 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:00:39.856278 4649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "22b89e4c494f4616b084b3e69e731b44"
format_stamp: "Formatted at 2026-08-11 19:00:39 on dist-test-slave-gjw7"
server_key: "15233f9556a0b57b5ee869742ccb5cdd"
server_key_iv: "45da89f7371ba4b7563bf1343c23506f"
server_key_version: "encryptionkey@0"
I20260811 19:00:39.856339 4649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:39.867985 4649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:39.869638 4649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:39.869767 4649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:39.869966 4649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:39.870258 4649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:39.870297 4649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:39.870431 4649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:39.870477 4649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:39.877089 4649 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:42399
I20260811 19:00:39.877151 4911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:42399 every 8 connection(s)
I20260811 19:00:39.877506 4649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 19:00:39.882726 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 4649
I20260811 19:00:39.882845 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 19:00:39.883044 6025 external_mini_cluster.cc:1428] Setting key 3f0915bf7c8a9f5174c2435e06e176f7
Aug 11 19:00:39 dist-test-slave-gjw7 krb5kdc[4426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474839, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:39.889752 4644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:39.878212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:53473 (local address 127.5.226.126:35241)
0811 19:00:39.878269 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:39.878271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:39.878479 (+ 208us) server_negotiation.cc:407] Connection header received
0811 19:00:39.879209 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:39.879210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:39.879221 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:39.879294 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:39.880583 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:39.881383 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:39.882795 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:39.883102 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:39.883177 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:39.886536 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:39.886538 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:39.886539 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:39.886547 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:39.888176 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:39.888687 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:39.888688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:39.888688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:39.888752 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:39.889043 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:39.889044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:39.889045 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:39.889202 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:39.889258 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:39.889600 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 19:00:39.889687 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 19:00:39.890007 4928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:39.878175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:53473)
0811 19:00:39.878329 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:39.878371 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:39.879085 (+ 714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:39.879378 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:39.879383 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:39.880178 (+ 795us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:39.880481 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:39.880489 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:39.881471 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:39.881472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:39.882686 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:39.882690 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:39.883202 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:39.883211 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:39.883374 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:39.884543 (+ 1169us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:39.884554 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:39.886445 (+ 1891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:39.888261 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:39.888269 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:39.888272 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:39.888607 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:39.888818 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:39.888819 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:39.888819 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:39.888972 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:39.889266 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:39.889272 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:39.889460 (+ 188us) client_negotiation.cc:769] Sending connection context
0811 19:00:39.889586 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 19:00:39.889768 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":76,"threads_started":1}
I20260811 19:00:39.890656 4924 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35241
I20260811 19:00:39.890760 4924 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:39.890936 4924 heartbeater.cc:511] Master 127.5.226.126:35241 requested a full tablet report, sending...
I20260811 19:00:39.891449 4519 ts_manager.cc:194] Registered new tserver with Master: 22b89e4c494f4616b084b3e69e731b44 (127.5.226.65:42399)
I20260811 19:00:39.892053 4519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:53473
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 19:00:39.909483 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35241
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:39.990393 4934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:39.990594 4934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:39.990615 4934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:39.991755 4934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:39.991797 4934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:39.991825 4934 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 19:00:39.993248 4934 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:39.993490 4934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:39.993710 4934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:39.998579 4944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:39.998597 4946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:39.998805 4934 server_base.cc:1034] running on GCE node
W20260811 19:00:39.998847 4942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:39.999087 4934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:39.999331 4934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:40.000465 4934 hybrid_clock.cc:648] HybridClock initialized: now 1786474840000454 us; error 27 us; skew 500 ppm
Aug 11 19:00:40 dist-test-slave-gjw7 krb5kdc[4426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474840, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:40.003221 4934 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 19:00:40.003744 4934 webserver.cc:460] Webserver started at http://127.5.226.66:46025/ using document root <none> and password file <none>
I20260811 19:00:40.003974 4934 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:40.004021 4934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:40.004154 4934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:40.005255 4934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "a01757ff5ab242f28d4470502e628b41"
format_stamp: "Formatted at 2026-08-11 19:00:40 on dist-test-slave-gjw7"
server_key: "7da9472f99119158b36f95d4ec03fa3e"
server_key_iv: "da2deba5d96041f5c7f3f35159775b03"
server_key_version: "encryptionkey@0"
I20260811 19:00:40.005652 4934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "a01757ff5ab242f28d4470502e628b41"
format_stamp: "Formatted at 2026-08-11 19:00:40 on dist-test-slave-gjw7"
server_key: "7da9472f99119158b36f95d4ec03fa3e"
server_key_iv: "da2deba5d96041f5c7f3f35159775b03"
server_key_version: "encryptionkey@0"
I20260811 19:00:40.006903 4934 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 19:00:40.007592 4956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:40.007762 4934 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:00:40.007849 4934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "a01757ff5ab242f28d4470502e628b41"
format_stamp: "Formatted at 2026-08-11 19:00:40 on dist-test-slave-gjw7"
server_key: "7da9472f99119158b36f95d4ec03fa3e"
server_key_iv: "da2deba5d96041f5c7f3f35159775b03"
server_key_version: "encryptionkey@0"
I20260811 19:00:40.007917 4934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:40.020118 4934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:40.021936 4934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:40.022074 4934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:40.022290 4934 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:40.022593 4934 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:40.022626 4934 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:40.022656 4934 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:40.022675 4934 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:40.028478 4934 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:34875
I20260811 19:00:40.028528 5163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:34875 every 8 connection(s)
I20260811 19:00:40.028841 4934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 19:00:40.034397 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 4934
I20260811 19:00:40.034500 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 19:00:40.034687 6025 external_mini_cluster.cc:1428] Setting key 57836d05b33bbb729945bffec629d014
Aug 11 19:00:40 dist-test-slave-gjw7 krb5kdc[4426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474840, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:40.038805 4644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.029541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:36199 (local address 127.5.226.126:35241)
0811 19:00:40.029617 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:40.029619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:40.029786 (+ 167us) server_negotiation.cc:407] Connection header received
0811 19:00:40.030382 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:40.030384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:40.030397 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:40.030437 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:40.031425 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.031937 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.032915 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.033119 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.033175 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.035410 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:40.035411 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:40.035412 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:40.035419 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:40.037048 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:40.037672 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:40.037673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:40.037673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:40.037743 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:40.038056 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:40.038057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:40.038058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:40.038224 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:40.038290 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:40.038644 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 19:00:40.038731 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 19:00:40.039055 5167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.029494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:36199)
0811 19:00:40.029664 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:40.029701 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:40.030221 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:40.030520 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:40.030524 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:40.031123 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:40.031325 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:40.031330 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.032024 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.032024 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:40.032833 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:40.032836 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.033189 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.033190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:40.033342 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.033790 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:40.033798 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:40.035322 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:40.037150 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:40.037160 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:40.037162 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:40.037572 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:40.037813 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:40.037814 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:40.037815 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:40.037968 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:40.038316 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:40.038328 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:40.038506 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 19:00:40.038628 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 19:00:40.038808 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":80,"threads_started":1}
I20260811 19:00:40.039606 5164 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35241
I20260811 19:00:40.039716 5164 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:40.039920 5164 heartbeater.cc:511] Master 127.5.226.126:35241 requested a full tablet report, sending...
I20260811 19:00:40.040315 4519 ts_manager.cc:194] Registered new tserver with Master: a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875)
I20260811 19:00:40.040853 4519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:36199
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 19:00:40.062071 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35241
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:40.144227 5173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:40.144429 5173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:40.144452 5173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:40.145630 5173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:40.145669 5173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:40.145695 5173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 19:00:40.147135 5173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:00:40.147351 5173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:40.147562 5173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:40.152294 5191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:40.152499 5187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:40.152633 5185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:40.152674 5173 server_base.cc:1034] running on GCE node
I20260811 19:00:40.152846 5173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:40.153051 5173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:40.154197 5173 hybrid_clock.cc:648] HybridClock initialized: now 1786474840154184 us; error 32 us; skew 500 ppm
Aug 11 19:00:40 dist-test-slave-gjw7 krb5kdc[4426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474840, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:40.156641 5173 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 19:00:40.157078 5173 webserver.cc:460] Webserver started at http://127.5.226.67:34329/ using document root <none> and password file <none>
I20260811 19:00:40.157271 5173 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:40.157368 5173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:40.157500 5173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:40.158545 5173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "1750db39714349729cb71c29275790bb"
format_stamp: "Formatted at 2026-08-11 19:00:40 on dist-test-slave-gjw7"
server_key: "21a8a2b79a1e707b5d8ca5f8bcade3e6"
server_key_iv: "a0a3039907ada2154cfc861ed2d06079"
server_key_version: "encryptionkey@0"
I20260811 19:00:40.158887 5173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "1750db39714349729cb71c29275790bb"
format_stamp: "Formatted at 2026-08-11 19:00:40 on dist-test-slave-gjw7"
server_key: "21a8a2b79a1e707b5d8ca5f8bcade3e6"
server_key_iv: "a0a3039907ada2154cfc861ed2d06079"
server_key_version: "encryptionkey@0"
I20260811 19:00:40.160193 5173 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 19:00:40.160915 5201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:40.161064 5173 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:00:40.161147 5173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "1750db39714349729cb71c29275790bb"
format_stamp: "Formatted at 2026-08-11 19:00:40 on dist-test-slave-gjw7"
server_key: "21a8a2b79a1e707b5d8ca5f8bcade3e6"
server_key_iv: "a0a3039907ada2154cfc861ed2d06079"
server_key_version: "encryptionkey@0"
I20260811 19:00:40.161217 5173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:40.167826 5173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:40.169881 5173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:40.170003 5173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:40.170197 5173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:00:40.170478 5173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:00:40.170511 5173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:40.170539 5173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:00:40.170564 5173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:40.176209 5173 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:39271
I20260811 19:00:40.176271 5413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:39271 every 8 connection(s)
I20260811 19:00:40.176558 5173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 19:00:40.177409 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 5173
I20260811 19:00:40.177511 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 19:00:40.177687 6025 external_mini_cluster.cc:1428] Setting key 0b82889db0345a5177a68fd29687c9cc
Aug 11 19:00:40 dist-test-slave-gjw7 krb5kdc[4426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474840, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:00:40.185611 4644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.177271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:38157 (local address 127.5.226.126:35241)
0811 19:00:40.177359 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:40.177361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:40.177552 (+ 191us) server_negotiation.cc:407] Connection header received
0811 19:00:40.178141 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:40.178142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:40.178155 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:40.178203 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:40.179259 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.179755 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.180725 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.180907 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.180951 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.183059 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:40.183061 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:40.183061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:40.183068 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:40.184304 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:40.184686 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:40.184687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:40.184688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:40.184745 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:40.184972 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:40.184973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:40.184973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:40.185089 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:40.185145 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:40.185441 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 19:00:40.185522 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 19:00:40.185770 5425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.177217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:38157)
0811 19:00:40.177432 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:40.177470 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:40.178028 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:40.178294 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:40.178298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:40.178955 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:40.179173 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:40.179179 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.179828 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.179829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:40.180659 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:40.180662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.180965 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.180966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:40.181064 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.181569 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:40.181580 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:40.182974 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:40.184379 (+ 1405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:40.184386 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:40.184388 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:40.184619 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:40.184813 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:40.184814 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:40.184814 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:40.184916 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:40.185144 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:40.185151 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:40.185283 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 19:00:40.185412 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 19:00:40.185567 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":99,"threads_started":1}
I20260811 19:00:40.186218 5421 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35241
I20260811 19:00:40.186317 5421 heartbeater.cc:464] Registering TS with master...
I20260811 19:00:40.186496 5421 heartbeater.cc:511] Master 127.5.226.126:35241 requested a full tablet report, sending...
I20260811 19:00:40.186866 4519 ts_manager.cc:194] Registered new tserver with Master: 1750db39714349729cb71c29275790bb (127.5.226.67:39271)
I20260811 19:00:40.187214 4519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:38157
I20260811 19:00:40.189316 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 19:00:40.196208 4644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.190689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47612 (local address 127.5.226.126:35241)
0811 19:00:40.190725 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:40.190727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:40.190862 (+ 135us) server_negotiation.cc:407] Connection header received
0811 19:00:40.190917 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:40.190918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:40.190925 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:40.190968 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:40.191526 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.191966 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.192703 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.192870 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.192911 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.194005 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:40.194007 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:40.194007 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:40.194014 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:40.195221 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:40.195533 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:40.195534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:40.195534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:40.195580 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:40.195725 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:40.195726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:40.195726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:40.195859 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:40.195944 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:40.196092 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 19:00:40.196150 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 19:00:40.197611 4519 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47612:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 19:00:40.199121 4519 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 19:00:40.205902 5447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.201524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34028 (local address 127.5.226.65:42399)
0811 19:00:40.201690 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:40.201694 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:40.201705 (+ 11us) server_negotiation.cc:407] Connection header received
0811 19:00:40.201743 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:40.201744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:40.201756 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:40.201848 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:40.202060 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.204069 (+ 2009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.204972 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.205527 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.205590 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.205652 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:40.205786 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 19:00:40.205826 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":84,"threads_started":1}
I20260811 19:00:40.205940 5444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.201268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:42399 (local address 127.0.0.1:34028)
0811 19:00:40.201506 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:40.201515 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:40.201552 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:40.201935 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:40.201937 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:40.201938 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:40.201984 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:40.201985 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.204151 (+ 2166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.204152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:40.204900 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:40.204902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.205601 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.205602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:40.205679 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.205702 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 19:00:40.205763 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 19:00:40.205820 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":93,"threads_started":1}
I20260811 19:00:40.206090 5441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.201193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33420 (local address 127.5.226.67:39271)
0811 19:00:40.201921 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:40.201925 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:40.201934 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:00:40.201968 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:40.201970 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:40.201984 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:40.202053 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:40.202253 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.203334 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.204815 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.205582 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.205651 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.205708 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:40.205978 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 19:00:40.206020 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":136,"threads_started":1}
I20260811 19:00:40.206197 5443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.201194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59056 (local address 127.5.226.66:34875)
0811 19:00:40.201659 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:40.201663 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:40.201671 (+ 8us) server_negotiation.cc:407] Connection header received
0811 19:00:40.201704 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:40.201706 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:40.201718 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:40.201784 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:40.201970 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.203092 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.204841 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.205582 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.205995 (+ 413us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.206062 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:40.206085 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 19:00:40.206126 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":122,"threads_started":1}
I20260811 19:00:40.205955 5439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.201081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:34875 (local address 127.0.0.1:59056)
0811 19:00:40.201274 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:40.201341 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:40.201408 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:40.201812 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:40.201816 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:40.201818 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:40.201883 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:40.201885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.203207 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.203208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:40.204574 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:40.204577 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.205682 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.205683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:40.205754 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.205758 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:00:40.205800 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 19:00:40.205845 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":1,"thread_start_us":51,"threads_started":1}
I20260811 19:00:40.206290 5438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.201095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:39271 (local address 127.0.0.1:33420)
0811 19:00:40.201459 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:40.201471 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:40.201524 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:40.202125 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:40.202125 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:40.202128 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:40.202173 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:40.202175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.203448 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.203449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:40.204746 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:40.204748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.205737 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.205738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:40.205786 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.205790 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:00:40.205832 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 19:00:40.205861 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":3,"thread_start_us":80,"threads_started":1}
I20260811 19:00:40.206991 5048 tablet_service.cc:1467] Processing CreateTablet for tablet 31761b41b7f644b39f6e73bc5d1323a9 (DEFAULT_TABLE table=test-table [id=7c88dc6488b047d6a08c413431782b60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:00:40.206993 5285 tablet_service.cc:1467] Processing CreateTablet for tablet 31761b41b7f644b39f6e73bc5d1323a9 (DEFAULT_TABLE table=test-table [id=7c88dc6488b047d6a08c413431782b60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:00:40.207333 5048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31761b41b7f644b39f6e73bc5d1323a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:40.207340 5285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31761b41b7f644b39f6e73bc5d1323a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:40.207310 4767 tablet_service.cc:1467] Processing CreateTablet for tablet 31761b41b7f644b39f6e73bc5d1323a9 (DEFAULT_TABLE table=test-table [id=7c88dc6488b047d6a08c413431782b60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:00:40.207610 4767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31761b41b7f644b39f6e73bc5d1323a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:40.209987 5449 tablet_bootstrap.cc:492] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41: Bootstrap starting.
I20260811 19:00:40.210660 5450 tablet_bootstrap.cc:492] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb: Bootstrap starting.
I20260811 19:00:40.210741 5449 tablet_bootstrap.cc:654] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:40.210889 5451 tablet_bootstrap.cc:492] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: Bootstrap starting.
I20260811 19:00:40.211397 5449 log.cc:824] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:40.211440 5450 tablet_bootstrap.cc:654] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:40.211469 5451 tablet_bootstrap.cc:654] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:40.212023 5450 log.cc:824] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:40.212126 5451 log.cc:824] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:40.212212 5449 tablet_bootstrap.cc:492] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41: No bootstrap required, opened a new log
I20260811 19:00:40.212281 5449 ts_tablet_manager.cc:1397] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:00:40.212738 5450 tablet_bootstrap.cc:492] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb: No bootstrap required, opened a new log
I20260811 19:00:40.212793 5450 ts_tablet_manager.cc:1397] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:00:40.212812 5451 tablet_bootstrap.cc:492] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: No bootstrap required, opened a new log
I20260811 19:00:40.212855 5451 ts_tablet_manager.cc:1397] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 19:00:40.214273 5449 raft_consensus.cc:348] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:00:40.214447 5449 raft_consensus.cc:374] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:40.214390 5451 raft_consensus.cc:348] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:00:40.214483 5449 raft_consensus.cc:729] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a01757ff5ab242f28d4470502e628b41, State: Initialized, Role: FOLLOWER
I20260811 19:00:40.214511 5451 raft_consensus.cc:374] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:40.214531 5451 raft_consensus.cc:729] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b89e4c494f4616b084b3e69e731b44, State: Initialized, Role: FOLLOWER
I20260811 19:00:40.214599 5449 consensus_queue.cc:260] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:00:40.214617 5451 consensus_queue.cc:260] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:00:40.214721 5450 raft_consensus.cc:348] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:00:40.214871 5450 raft_consensus.cc:374] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:00:40.214892 5449 ts_tablet_manager.cc:1428] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 19:00:40.214892 5451 ts_tablet_manager.cc:1428] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:00:40.214905 5450 raft_consensus.cc:729] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1750db39714349729cb71c29275790bb, State: Initialized, Role: FOLLOWER
I20260811 19:00:40.214915 5164 heartbeater.cc:503] Master 127.5.226.126:35241 was elected leader, sending a full tablet report...
I20260811 19:00:40.215032 4924 heartbeater.cc:503] Master 127.5.226.126:35241 was elected leader, sending a full tablet report...
I20260811 19:00:40.215006 5450 consensus_queue.cc:260] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:00:40.215248 5450 ts_tablet_manager.cc:1428] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 19:00:40.215540 5421 heartbeater.cc:503] Master 127.5.226.126:35241 was elected leader, sending a full tablet report...
I20260811 19:00:40.254992 5457 raft_consensus.cc:482] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:00:40.255116 5457 raft_consensus.cc:504] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:00:40.255460 5457 leader_election.cc:288] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875), 1750db39714349729cb71c29275790bb (127.5.226.67:39271)
I20260811 19:00:40.258219 4928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.255636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:39271 (local address 127.5.226.65:37143)
0811 19:00:40.255687 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:40.255699 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:40.255744 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:40.255912 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:40.255913 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:40.255916 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:40.256007 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:40.256009 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.256655 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.256656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:40.257459 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:40.257461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.257987 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.257988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:40.258058 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.258061 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:00:40.258105 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 19:00:40.258145 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 19:00:40.258219 5441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.255705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:37143 (local address 127.5.226.67:39271)
0811 19:00:40.255750 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:40.255752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:40.255765 (+ 13us) server_negotiation.cc:407] Connection header received
0811 19:00:40.255819 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:40.255820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:40.255828 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:40.255866 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:40.256085 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.256582 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.257536 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.257918 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.257980 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.257989 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:40.258117 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 19:00:40.258158 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 19:00:40.258394 5443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.255704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:54141 (local address 127.5.226.66:34875)
0811 19:00:40.255761 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:40.255763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:40.256058 (+ 295us) server_negotiation.cc:407] Connection header received
0811 19:00:40.256095 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:40.256096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:40.256108 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:40.256160 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:00:40.256319 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.256763 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.257704 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.258085 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.258149 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.258157 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:40.258294 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 19:00:40.258327 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 19:00:40.258406 5460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.255636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:34875 (local address 127.5.226.65:54141)
0811 19:00:40.255991 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:40.256000 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:40.256051 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:40.256171 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:40.256171 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:40.256173 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:00:40.256243 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:40.256245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.256839 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.256840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:40.257629 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:40.257631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.258156 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.258157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:40.258229 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.258233 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:00:40.258287 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 19:00:40.258324 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":152,"thread_start_us":131,"threads_started":1}
I20260811 19:00:40.258685 5323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31761b41b7f644b39f6e73bc5d1323a9" candidate_uuid: "22b89e4c494f4616b084b3e69e731b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1750db39714349729cb71c29275790bb" is_pre_election: true
I20260811 19:00:40.258797 5082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31761b41b7f644b39f6e73bc5d1323a9" candidate_uuid: "22b89e4c494f4616b084b3e69e731b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a01757ff5ab242f28d4470502e628b41" is_pre_election: true
I20260811 19:00:40.258853 5323 raft_consensus.cc:2454] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22b89e4c494f4616b084b3e69e731b44 in term 0.
I20260811 19:00:40.258957 5082 raft_consensus.cc:2454] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22b89e4c494f4616b084b3e69e731b44 in term 0.
I20260811 19:00:40.259110 4680 leader_election.cc:302] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1750db39714349729cb71c29275790bb, 22b89e4c494f4616b084b3e69e731b44; no voters:
I20260811 19:00:40.259267 5457 raft_consensus.cc:2781] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 19:00:40.259330 5457 raft_consensus.cc:482] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 19:00:40.259364 5457 raft_consensus.cc:3037] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:40.260126 5457 raft_consensus.cc:504] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:00:40.260267 5457 leader_election.cc:288] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 1 election: Requested vote from peers a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875), 1750db39714349729cb71c29275790bb (127.5.226.67:39271)
I20260811 19:00:40.260432 5323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31761b41b7f644b39f6e73bc5d1323a9" candidate_uuid: "22b89e4c494f4616b084b3e69e731b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1750db39714349729cb71c29275790bb"
I20260811 19:00:40.260504 5323 raft_consensus.cc:3037] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:40.261200 5323 raft_consensus.cc:2454] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22b89e4c494f4616b084b3e69e731b44 in term 1.
I20260811 19:00:40.261336 5082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31761b41b7f644b39f6e73bc5d1323a9" candidate_uuid: "22b89e4c494f4616b084b3e69e731b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a01757ff5ab242f28d4470502e628b41"
I20260811 19:00:40.261384 4680 leader_election.cc:302] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1750db39714349729cb71c29275790bb, 22b89e4c494f4616b084b3e69e731b44; no voters:
I20260811 19:00:40.261412 5082 raft_consensus.cc:3037] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:40.261477 5457 raft_consensus.cc:2781] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:00:40.261651 5457 raft_consensus.cc:686] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 1 LEADER]: Becoming Leader. State: Replica: 22b89e4c494f4616b084b3e69e731b44, State: Running, Role: LEADER
I20260811 19:00:40.261750 5457 consensus_queue.cc:237] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:00:40.262315 5082 raft_consensus.cc:2454] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22b89e4c494f4616b084b3e69e731b44 in term 1.
I20260811 19:00:40.262805 4519 catalog_manager.cc:5495] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22b89e4c494f4616b084b3e69e731b44 (127.5.226.65). New cstate: current_term: 1 leader_uuid: "22b89e4c494f4616b084b3e69e731b44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } health_report { overall_health: HEALTHY } } }
I20260811 19:00:40.278450 5447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.276176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34030 (local address 127.5.226.65:42399)
0811 19:00:40.276222 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:40.276224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:40.276232 (+ 8us) server_negotiation.cc:407] Connection header received
0811 19:00:40.276302 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:40.276303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:40.276320 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:40.276382 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:00:40.276489 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.276947 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.277685 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:40.277885 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:40.277940 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:40.278097 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:00:40.278249 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:00:40.278331 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:40.278346 (+ 15us) server_negotiation.cc:299] Negotiation successful
0811 19:00:40.278369 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 19:00:40.279392 5165 tablet.cc:2369] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:00:40.280372 5082 raft_consensus.cc:1261] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41 [term 1 FOLLOWER]: Refusing update from remote peer 22b89e4c494f4616b084b3e69e731b44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:00:40.280369 5323 raft_consensus.cc:1261] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb [term 1 FOLLOWER]: Refusing update from remote peer 22b89e4c494f4616b084b3e69e731b44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:00:40.280673 5457 consensus_queue.cc:1035] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:00:40.280824 5462 consensus_queue.cc:1035] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:00:40.283936 5467 mvcc.cc:205] Tried to move back new op lower bound from 7317400945785548800 to 7317400945712758784. Current Snapshot: MvccSnapshot[applied={T|T < 7317400945785548800}]
I20260811 19:00:40.285430 4519 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:00:40.285530 4519 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:00:40.286191 4519 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Sending DeleteTablet for 3 replicas of tablet 31761b41b7f644b39f6e73bc5d1323a9
I20260811 19:00:40.286571 5285 tablet_service.cc:1514] Processing DeleteTablet for tablet 31761b41b7f644b39f6e73bc5d1323a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:00:40 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:33420
I20260811 19:00:40.286581 4767 tablet_service.cc:1514] Processing DeleteTablet for tablet 31761b41b7f644b39f6e73bc5d1323a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:00:40 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:34028
I20260811 19:00:40.286803 5048 tablet_service.cc:1514] Processing DeleteTablet for tablet 31761b41b7f644b39f6e73bc5d1323a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:00:40 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:59056
I20260811 19:00:40.287025 5483 tablet_replica.cc:330] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41: stopping tablet replica
I20260811 19:00:40.287037 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 4649
I20260811 19:00:40.287125 5483 raft_consensus.cc:2229] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:00:40.287271 5483 raft_consensus.cc:2258] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:00:40.294690 5483 ts_tablet_manager.cc:1905] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:00:40.296404 5483 ts_tablet_manager.cc:1918] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:00:40.296485 5483 log.cc:1196] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/31761b41b7f644b39f6e73bc5d1323a9
I20260811 19:00:40.296743 5483 ts_tablet_manager.cc:1939] T 31761b41b7f644b39f6e73bc5d1323a9 P a01757ff5ab242f28d4470502e628b41: Deleting consensus metadata
I20260811 19:00:40.297188 4493 catalog_manager.cc:4841] TS a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875): tablet 31761b41b7f644b39f6e73bc5d1323a9 (table test-table [id=7c88dc6488b047d6a08c413431782b60]) successfully deleted
I20260811 19:00:40.298465 5481 tablet_replica.cc:330] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb: stopping tablet replica
I20260811 19:00:40.298609 5481 raft_consensus.cc:2229] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:00:40.298733 5481 raft_consensus.cc:2258] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:00:40.302577 5481 ts_tablet_manager.cc:1905] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:00:40.304214 5481 ts_tablet_manager.cc:1918] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:00:40.304297 5481 log.cc:1196] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/31761b41b7f644b39f6e73bc5d1323a9
I20260811 19:00:40.304564 5481 ts_tablet_manager.cc:1939] T 31761b41b7f644b39f6e73bc5d1323a9 P 1750db39714349729cb71c29275790bb: Deleting consensus metadata
I20260811 19:00:40.305047 4491 catalog_manager.cc:4841] TS 1750db39714349729cb71c29275790bb (127.5.226.67:39271): tablet 31761b41b7f644b39f6e73bc5d1323a9 (table test-table [id=7c88dc6488b047d6a08c413431782b60]) successfully deleted
W20260811 19:00:40.307117 4493 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:42399 (error 108)
I20260811 19:00:40.307293 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 4934
I20260811 19:00:40.309733 5438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:40.309601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:42399 (local address 127.0.0.1:34042)
0811 19:00:40.309650 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:40.309687 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 19:00:40.309862 4493 catalog_manager.cc:4584] TS 22b89e4c494f4616b084b3e69e731b44 (127.5.226.65:42399): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 31761b41b7f644b39f6e73bc5d1323a9: Network error: Client connection negotiation failed: client connection to 127.5.226.65:42399: connect: Connection refused (error 111)
I20260811 19:00:40.318598 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 5173
I20260811 19:00:40.337368 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 4455
I20260811 19:01:00.354387 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:35241
--webserver_interface=127.5.226.126
--webserver_port=44813
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:35241
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:00.440852 5487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:00.441066 5487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:00.441089 5487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:00.442282 5487 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 19:01:00.442327 5487 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 19:01:00.442342 5487 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 19:01:00.442354 5487 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:00.442370 5487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:00.442399 5487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:00.442426 5487 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:00.442452 5487 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:00.443924 5487 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:35241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:35241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=44813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:00.444176 5487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:00.444412 5487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:00.453884 5496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:00.453965 5498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:00.454020 5487 server_base.cc:1034] running on GCE node
W20260811 19:01:00.453889 5500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:00.454457 5487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:00.454771 5487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:00.455920 5487 hybrid_clock.cc:648] HybridClock initialized: now 1786474860455901 us; error 33 us; skew 500 ppm
Aug 11 19:01:00 dist-test-slave-gjw7 krb5kdc[4426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474860, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:00.461254 5487 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:01:00.461735 5487 webserver.cc:460] Webserver started at http://127.5.226.126:44813/ using document root <none> and password file <none>
I20260811 19:01:00.461968 5487 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:00.462033 5487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:00.463449 5487 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:01:00.464078 5514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:00.464226 5487 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:00.464319 5487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "bfba7b47f08f4cb19a05028b8cf27957"
format_stamp: "Formatted at 2026-08-11 19:00:39 on dist-test-slave-gjw7"
server_key: "6202a4cfe0247cd2a6834e62a0fdd930"
server_key_iv: "fa7e664c223dfccdffb0704f6e006cfc"
server_key_version: "encryptionkey@0"
I20260811 19:01:00.464736 5487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:00.475167 5487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:00.477414 5487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:00.477558 5487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:00.481621 5487 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:35241
I20260811 19:01:00.481655 5617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:35241 every 8 connection(s)
I20260811 19:01:00.482049 5487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:00.483566 5618 sys_catalog.cc:263] Verifying existing consensus state
I20260811 19:01:00.484234 5618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Bootstrap starting.
I20260811 19:01:00.491037 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 5487
I20260811 19:01:00.491397 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:42399
--local_ip_for_outbound_sockets=127.5.226.65
--tserver_master_addrs=127.5.226.126:35241
--webserver_port=44693
--webserver_interface=127.5.226.65
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:01:00.493683 5618 log.cc:824] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:00.495576 5618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 19:01:00.495911 5618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Bootstrap complete.
I20260811 19:01:00.498196 5618 raft_consensus.cc:348] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } }
I20260811 19:01:00.498433 5618 raft_consensus.cc:729] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfba7b47f08f4cb19a05028b8cf27957, State: Initialized, Role: FOLLOWER
I20260811 19:01:00.498584 5618 consensus_queue.cc:260] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } }
I20260811 19:01:00.498644 5618 raft_consensus.cc:388] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:00.498697 5618 raft_consensus.cc:482] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:00.498746 5618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 1 FOLLOWER]: Advancing to term 2
I20260811 19:01:00.499756 5618 raft_consensus.cc:504] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } }
I20260811 19:01:00.499850 5618 leader_election.cc:302] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bfba7b47f08f4cb19a05028b8cf27957; no voters:
I20260811 19:01:00.500001 5618 leader_election.cc:288] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 19:01:00.500052 5622 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 19:01:00.500222 5622 raft_consensus.cc:686] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 2 LEADER]: Becoming Leader. State: Replica: bfba7b47f08f4cb19a05028b8cf27957, State: Running, Role: LEADER
I20260811 19:01:00.500294 5618 sys_catalog.cc:564] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:00.500376 5622 consensus_queue.cc:237] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } }
I20260811 19:01:00.500654 5622 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bfba7b47f08f4cb19a05028b8cf27957. Latest consensus state: current_term: 2 leader_uuid: "bfba7b47f08f4cb19a05028b8cf27957" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } } }
I20260811 19:01:00.500834 5626 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "bfba7b47f08f4cb19a05028b8cf27957" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } } }
I20260811 19:01:00.500909 5622 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:00.501168 5626 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:00.501360 5644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:00.502202 5644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:00.502353 5644 catalog_manager.cc:1259] Loaded cluster ID: c5f69f4cd5e349988e9282b875e03620
I20260811 19:01:00.502583 5644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:00.503861 5644 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:00.504031 5644 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Loaded TSK: 0
I20260811 19:01:00.526968 5644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Generated new TSK 1
I20260811 19:01:00.527091 5644 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 19:01:00.583735 5620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:00.583940 5620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:00.583962 5620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:00.585109 5620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:00.585152 5620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:00.585177 5620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 19:01:00.586716 5620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:42399
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=44693
--tserver_master_addrs=127.5.226.126:35241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:00.586936 5620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:00.587173 5620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:00.592602 5675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:00.592612 5671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:00.592612 5670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:00.593000 5620 server_base.cc:1034] running on GCE node
I20260811 19:01:00.593185 5620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:00.593465 5620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:00.594623 5620 hybrid_clock.cc:648] HybridClock initialized: now 1786474860594613 us; error 27 us; skew 500 ppm
Aug 11 19:01:00 dist-test-slave-gjw7 krb5kdc[4426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474860, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:00.597060 5620 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 19:01:00.597568 5620 webserver.cc:460] Webserver started at http://127.5.226.65:44693/ using document root <none> and password file <none>
I20260811 19:01:00.597810 5620 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:00.597872 5620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:00.599212 5620 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:01:00.599879 5686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:00.600039 5620 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:00.600117 5620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "22b89e4c494f4616b084b3e69e731b44"
format_stamp: "Formatted at 2026-08-11 19:00:39 on dist-test-slave-gjw7"
server_key: "15233f9556a0b57b5ee869742ccb5cdd"
server_key_iv: "45da89f7371ba4b7563bf1343c23506f"
server_key_version: "encryptionkey@0"
I20260811 19:01:00.600512 5620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:00.610028 5620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:00.612109 5620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:00.612246 5620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:00.612474 5620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:00.612934 5701 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 19:01:00.614493 5620 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 19:01:00.614544 5620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 19:01:00.614569 5620 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 19:01:00.615240 5620 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 19:01:00.615284 5620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 19:01:00.615357 5701 tablet_bootstrap.cc:492] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: Bootstrap starting.
I20260811 19:01:00.623045 5620 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:42399
I20260811 19:01:00.623598 5620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 19:01:00.624264 5897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:42399 every 8 connection(s)
I20260811 19:01:00.626778 5701 log.cc:824] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:00.627818 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 5620
I20260811 19:01:00.628083 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:34875
--local_ip_for_outbound_sockets=127.5.226.66
--tserver_master_addrs=127.5.226.126:35241
--webserver_port=46025
--webserver_interface=127.5.226.66
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:01:00.629338 5701 tablet_bootstrap.cc:492] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 19:01:00.629593 5701 tablet_bootstrap.cc:492] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: Bootstrap complete.
I20260811 19:01:00.630779 5701 ts_tablet_manager.cc:1397] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.008s
I20260811 19:01:00.631873 5701 raft_consensus.cc:348] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:00.632110 5701 raft_consensus.cc:729] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b89e4c494f4616b084b3e69e731b44, State: Initialized, Role: FOLLOWER
Aug 11 19:01:00 dist-test-slave-gjw7 krb5kdc[4426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474860, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:01:00.632244 5701 consensus_queue.cc:260] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:00.632530 5701 ts_tablet_manager.cc:1428] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260811 19:01:00.636219 5900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:00.624338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:39143)
0811 19:01:00.625411 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:00.625460 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:00.626045 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:00.626602 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:00.626607 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:00.626990 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:00.627269 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:00.627278 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.628880 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.628881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:00.630034 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:00.630038 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.630599 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.630600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:00.630731 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:00.631246 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:00.631255 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:00.632675 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:00.634710 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:00.634717 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:00.634719 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:00.634946 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:00.635207 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:00.635208 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:00.635208 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:00.635300 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:00.635735 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:00.635739 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:00.635850 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 19:01:00.635942 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 19:01:00.636073 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1024,"thread_start_us":92,"threads_started":1}
I20260811 19:01:00.636394 5904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:00.624385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:39143 (local address 127.5.226.126:35241)
0811 19:01:00.625494 (+ 1109us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:00.625505 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:00.625550 (+ 45us) server_negotiation.cc:407] Connection header received
0811 19:01:00.626303 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:00.626312 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:00.626395 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:00.626559 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:00.627411 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.628735 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.630117 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.630508 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.630605 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:00.632771 (+ 2166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:00.632775 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:00.632775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:00.632788 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:00.634614 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:00.635023 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:00.635027 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:00.635028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:00.635144 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:00.635361 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:00.635362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:00.635362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:00.635664 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:00.635768 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:00.636034 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 19:01:00.636183 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1046,"thread_start_us":97,"threads_started":1}
I20260811 19:01:00.637065 5898 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35241
I20260811 19:01:00.637172 5898 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:00.637394 5898 heartbeater.cc:511] Master 127.5.226.126:35241 requested a full tablet report, sending...
I20260811 19:01:00.638247 5557 ts_manager.cc:194] Registered new tserver with Master: 22b89e4c494f4616b084b3e69e731b44 (127.5.226.65:42399)
I20260811 19:01:00.639477 5557 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:39143
I20260811 19:01:00.640638 5898 heartbeater.cc:503] Master 127.5.226.126:35241 was elected leader, sending a full tablet report...
Aug 11 19:01:00 dist-test-slave-gjw7 krb5kdc[4426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474860, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for kudu/127.5.226.65@KRBTEST.COM
I20260811 19:01:00.646525 5910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:00.639142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51442 (local address 127.5.226.65:42399)
0811 19:01:00.639303 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:00.639307 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:00.639316 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:01:00.639345 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:00.639347 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:00.639357 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:00.639417 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:00.639877 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.640539 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.641477 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.641768 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.641827 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:00.643885 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:00.643893 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:00.643894 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:00.643901 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:00.645376 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:00.645720 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:00.645723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:00.645724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:00.645780 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:00.645953 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:00.645954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:00.645954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:00.646095 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:00.646166 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:00.646346 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 19:01:00.646437 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":78,"threads_started":1}
I20260811 19:01:00.646525 5909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:00.638920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:42399 (local address 127.0.0.1:51442)
0811 19:01:00.639089 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:00.639124 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:00.639190 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:00.639431 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:00.639436 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:00.639733 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:00.639792 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:00.639795 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.640618 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.640619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:00.641410 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:00.641413 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.641843 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.641844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:00.641925 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:00.642366 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:00.642372 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:00.643798 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:00.645448 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:00.645455 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:00.645458 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:00.645646 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:00.645843 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:00.645844 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:00.645844 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:00.645903 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:00.646157 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:00.646165 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:00.646218 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 19:01:00.646293 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 19:01:00.646418 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":96,"threads_started":1}
I20260811 19:01:00.647045 5792 tablet_service.cc:1514] Processing DeleteTablet for tablet 31761b41b7f644b39f6e73bc5d1323a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:00:40 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:51442
I20260811 19:01:00.647578 5915 tablet_replica.cc:330] stopping tablet replica
I20260811 19:01:00.647671 5915 raft_consensus.cc:2229] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:01:00.647743 5915 raft_consensus.cc:2258] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:00.648056 5915 ts_tablet_manager.cc:1905] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:00.650621 5915 ts_tablet_manager.cc:1918] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:00.650712 5915 log.cc:1196] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal/wals/31761b41b7f644b39f6e73bc5d1323a9
I20260811 19:01:00.650971 5915 ts_tablet_manager.cc:1939] T 31761b41b7f644b39f6e73bc5d1323a9 P 22b89e4c494f4616b084b3e69e731b44: Deleting consensus metadata
I20260811 19:01:00.651525 5519 catalog_manager.cc:4841] TS 22b89e4c494f4616b084b3e69e731b44 (127.5.226.65:42399): tablet 31761b41b7f644b39f6e73bc5d1323a9 (table test-table [id=7c88dc6488b047d6a08c413431782b60]) successfully deleted
W20260811 19:01:00.715801 5907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:00.716039 5907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:00.716069 5907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:00.717329 5907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:00.717391 5907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:00.717433 5907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 19:01:00.718935 5907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:34875
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=46025
--tserver_master_addrs=127.5.226.126:35241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:00.719192 5907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:00.719411 5907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:00.724290 5930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:00.724272 5926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:00.724378 5907 server_base.cc:1034] running on GCE node
W20260811 19:01:00.724320 5927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:00.724715 5907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:00.724963 5907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:00.726100 5907 hybrid_clock.cc:648] HybridClock initialized: now 1786474860726086 us; error 31 us; skew 500 ppm
Aug 11 19:01:00 dist-test-slave-gjw7 krb5kdc[4426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474860, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:00.728763 5907 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 19:01:00.729187 5907 webserver.cc:460] Webserver started at http://127.5.226.66:46025/ using document root <none> and password file <none>
I20260811 19:01:00.729442 5907 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:00.729511 5907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:00.730860 5907 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:01:00.731415 5944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:00.731568 5907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:00.731652 5907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "a01757ff5ab242f28d4470502e628b41"
format_stamp: "Formatted at 2026-08-11 19:00:40 on dist-test-slave-gjw7"
server_key: "7da9472f99119158b36f95d4ec03fa3e"
server_key_iv: "da2deba5d96041f5c7f3f35159775b03"
server_key_version: "encryptionkey@0"
I20260811 19:01:00.731993 5907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:00.751654 5907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:00.753799 5907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:00.753952 5907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:00.754199 5907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:00.754516 5907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:00.754554 5907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:00.754582 5907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:00.754603 5907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:00.760154 5907 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:34875
I20260811 19:01:00.760226 6164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:34875 every 8 connection(s)
I20260811 19:01:00.760556 5907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 19:01:00.766171 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 5907
I20260811 19:01:00.766444 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:39271
--local_ip_for_outbound_sockets=127.5.226.67
--tserver_master_addrs=127.5.226.126:35241
--webserver_port=34329
--webserver_interface=127.5.226.67
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 19:01:00 dist-test-slave-gjw7 krb5kdc[4426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474860, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:01:00.770068 5904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:00.761319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:53129 (local address 127.5.226.126:35241)
0811 19:01:00.761377 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:00.761379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:00.761559 (+ 180us) server_negotiation.cc:407] Connection header received
0811 19:01:00.762091 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:00.762092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:00.762105 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:00.762158 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:00.763098 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.763612 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.764601 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.764823 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.764882 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:00.767146 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:00.767148 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:00.767148 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:00.767156 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:00.768689 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:00.769075 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:00.769077 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:00.769077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:00.769143 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:00.769398 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:00.769399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:00.769399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:00.769551 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:00.769621 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:00.769924 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 19:01:00.770001 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 19:01:00.770280 6167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:00.761248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:53129)
0811 19:01:00.761441 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:00.761479 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:00.761986 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:00.762230 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:00.762234 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:00.762791 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:00.762994 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:00.763000 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.763705 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.763706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:00.764508 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:00.764511 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.764902 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.764903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:00.765031 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:00.765486 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:00.765494 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:00.767049 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:00.768772 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:00.768779 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:00.768781 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:00.769007 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:00.769205 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:00.769206 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:00.769206 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:00.769345 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:00.769610 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:00.769615 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:00.769778 (+ 163us) client_negotiation.cc:769] Sending connection context
0811 19:01:00.769894 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 19:01:00.770058 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":109,"threads_started":1}
I20260811 19:01:00.770902 6165 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35241
I20260811 19:01:00.771003 6165 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:00.771191 6165 heartbeater.cc:511] Master 127.5.226.126:35241 requested a full tablet report, sending...
I20260811 19:01:00.771600 5557 ts_manager.cc:194] Registered new tserver with Master: a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875)
I20260811 19:01:00.771970 5557 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:53129
W20260811 19:01:00.849997 6168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:00.850198 6168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:00.850220 6168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:00.851377 6168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:00.851418 6168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:00.851444 6168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 19:01:00.852877 6168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:39271
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=34329
--tserver_master_addrs=127.5.226.126:35241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:00.853091 6168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:00.853327 6168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:00.858194 6183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:00.858247 6180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:00.858218 6179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:00.858511 6168 server_base.cc:1034] running on GCE node
I20260811 19:01:00.858681 6168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:00.858881 6168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:00.860016 6168 hybrid_clock.cc:648] HybridClock initialized: now 1786474860860000 us; error 30 us; skew 500 ppm
Aug 11 19:01:00 dist-test-slave-gjw7 krb5kdc[4426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474860, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:00.862376 6168 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 19:01:00.862807 6168 webserver.cc:460] Webserver started at http://127.5.226.67:34329/ using document root <none> and password file <none>
I20260811 19:01:00.863011 6168 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:00.863076 6168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:00.864411 6168 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:01:00.864933 6195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:00.865103 6168 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:00.865191 6168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "1750db39714349729cb71c29275790bb"
format_stamp: "Formatted at 2026-08-11 19:00:40 on dist-test-slave-gjw7"
server_key: "21a8a2b79a1e707b5d8ca5f8bcade3e6"
server_key_iv: "a0a3039907ada2154cfc861ed2d06079"
server_key_version: "encryptionkey@0"
I20260811 19:01:00.865582 6168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:00.883006 6168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:00.884994 6168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:00.885136 6168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:00.885404 6168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:00.885718 6168 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:00.885754 6168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:00.885784 6168 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:00.885807 6168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:00.891607 6168 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:39271
I20260811 19:01:00.891667 6382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:39271 every 8 connection(s)
I20260811 19:01:00.891996 6168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 19:01:00.893167 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 6168
Aug 11 19:01:00 dist-test-slave-gjw7 krb5kdc[4426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474860, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:01:00.900013 6390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:00.893563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40932 (local address 127.5.226.126:35241)
0811 19:01:00.893828 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:00.893829 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:00.893835 (+ 6us) server_negotiation.cc:407] Connection header received
0811 19:01:00.893855 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:00.893855 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:00.893864 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:00.893917 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:00.894512 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.895017 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.895797 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.896007 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.896062 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:00.897307 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:00.897309 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:00.897309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:00.897318 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:00.898840 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:00.899160 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:00.899161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:00.899162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:00.899229 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:00.899392 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:00.899393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:00.899393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:00.899506 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:00.899676 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:00.899715 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 19:01:00.899793 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":56,"threads_started":1}
I20260811 19:01:00.901085 5904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:00.892739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:60049 (local address 127.5.226.126:35241)
0811 19:01:00.892801 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:00.892803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:00.892986 (+ 183us) server_negotiation.cc:407] Connection header received
0811 19:01:00.893566 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:00.893568 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:00.893581 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:00.893632 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:00.894577 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.895040 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.896024 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.896213 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.896267 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:00.898354 (+ 2087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:00.898356 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:00.898356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:00.898363 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:00.899606 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:00.900027 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:00.900028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:00.900028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:00.900088 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:00.900423 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:00.900424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:00.900424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:00.900557 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:00.900618 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:00.900916 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 19:01:00.900998 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 19:01:00.901369 6387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:00.892704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:60049)
0811 19:01:00.892865 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:00.892908 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:00.893457 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:00.893705 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:00.893709 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:00.894276 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:00.894480 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:00.894485 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.895131 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.895132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:00.895938 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:00.895941 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.896283 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.896284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:00.896403 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:00.896789 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:00.896797 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:00.898263 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:00.899683 (+ 1420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:00.899691 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:00.899694 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:00.899917 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:00.900150 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:00.900151 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:00.900151 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:00.900365 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:00.900622 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:00.900630 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:00.900775 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 19:01:00.900893 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 19:01:00.901112 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":79,"threads_started":1}
I20260811 19:01:00.901779 6383 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35241
I20260811 19:01:00.901871 6383 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:00.902051 6383 heartbeater.cc:511] Master 127.5.226.126:35241 requested a full tablet report, sending...
I20260811 19:01:00.902374 5557 ts_manager.cc:194] Registered new tserver with Master: 1750db39714349729cb71c29275790bb (127.5.226.67:39271)
I20260811 19:01:00.902761 5557 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:60049
I20260811 19:01:00.911757 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 19:01:00.914485 5904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:00.912147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40940 (local address 127.5.226.126:35241)
0811 19:01:00.912223 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:00.912224 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:00.912309 (+ 85us) server_negotiation.cc:407] Connection header received
0811 19:01:00.912383 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:00.912384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:00.912424 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:00.912489 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:01:00.912597 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.913081 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.913865 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.914064 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.914125 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:00.914224 (+ 99us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:01:00.914328 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:01:00.914392 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:00.914406 (+ 14us) server_negotiation.cc:299] Negotiation successful
0811 19:01:00.914423 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 19:01:00.914801 5557 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:40940:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 19:01:00.916495 5557 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 19:01:00.918852 5792 tablet_service.cc:1467] Processing CreateTablet for tablet b9e1b05327484272a1c8fc0c65ea0c18 (DEFAULT_TABLE table=test-table [id=1f732ab24577470dbe37dc6a1367f5ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:00.919072 5792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9e1b05327484272a1c8fc0c65ea0c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:00.920468 5701 tablet_bootstrap.cc:492] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44: Bootstrap starting.
I20260811 19:01:00.920770 5701 tablet_bootstrap.cc:654] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:00.921772 5701 tablet_bootstrap.cc:492] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44: No bootstrap required, opened a new log
I20260811 19:01:00.921826 5701 ts_tablet_manager.cc:1397] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 19:01:00.921980 5701 raft_consensus.cc:348] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:00.922065 5701 raft_consensus.cc:374] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:00.922118 5701 raft_consensus.cc:729] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b89e4c494f4616b084b3e69e731b44, State: Initialized, Role: FOLLOWER
I20260811 19:01:00.922173 5701 consensus_queue.cc:260] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:00.922276 5701 ts_tablet_manager.cc:1428] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:00.922601 6397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:00.918526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47448 (local address 127.5.226.67:39271)
0811 19:01:00.918714 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:00.918719 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:00.918814 (+ 95us) server_negotiation.cc:407] Connection header received
0811 19:01:00.918881 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:00.918884 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:00.918901 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:00.918987 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:00.919234 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.920370 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.921421 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.922107 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.922154 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:00.922212 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:00.922473 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 19:01:00.922520 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":88,"threads_started":1}
I20260811 19:01:00.922659 5909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:00.918405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:34875 (local address 127.0.0.1:44326)
0811 19:01:00.918524 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:00.918535 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:00.918566 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:00.918969 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:00.918970 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:00.918971 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:00.919020 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:00.919022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.920288 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.920289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:00.921421 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:00.921424 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.922469 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.922470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:00.922545 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:00.922548 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:01:00.922571 (+ 23us) client_negotiation.cc:240] Negotiation successful
0811 19:01:00.922607 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260811 19:01:00.922801 6396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:00.918405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:39271 (local address 127.0.0.1:47448)
0811 19:01:00.918739 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:00.918748 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:00.918803 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:00.919094 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:00.919095 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:00.919097 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:00.919142 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:00.919143 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.920444 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.920445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:00.921312 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:00.921316 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.922275 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.922276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:00.922349 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:00.922371 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 19:01:00.922687 (+ 316us) client_negotiation.cc:240] Negotiation successful
0811 19:01:00.922737 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":19,"thread_start_us":119,"threads_started":1}
I20260811 19:01:00.923064 6399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:00.918512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44326 (local address 127.5.226.66:34875)
0811 19:01:00.918808 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:00.918812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:00.918821 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:01:00.918862 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:00.918864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:00.918880 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:00.918954 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:00.919081 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.920194 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.921599 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:00.922373 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:00.922822 (+ 449us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:00.922903 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:00.922929 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 19:01:00.922971 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":106,"threads_started":1}
I20260811 19:01:00.923520 6289 tablet_service.cc:1467] Processing CreateTablet for tablet b9e1b05327484272a1c8fc0c65ea0c18 (DEFAULT_TABLE table=test-table [id=1f732ab24577470dbe37dc6a1367f5ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:00.923671 6044 tablet_service.cc:1467] Processing CreateTablet for tablet b9e1b05327484272a1c8fc0c65ea0c18 (DEFAULT_TABLE table=test-table [id=1f732ab24577470dbe37dc6a1367f5ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:00.923806 6289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9e1b05327484272a1c8fc0c65ea0c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:00.924032 6044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9e1b05327484272a1c8fc0c65ea0c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:00.926519 6401 tablet_bootstrap.cc:492] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb: Bootstrap starting.
I20260811 19:01:00.926568 6402 tablet_bootstrap.cc:492] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41: Bootstrap starting.
I20260811 19:01:00.927199 6401 tablet_bootstrap.cc:654] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:00.927311 6402 tablet_bootstrap.cc:654] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:00.927697 6401 log.cc:824] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:00.927806 6402 log.cc:824] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:00.928442 6401 tablet_bootstrap.cc:492] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb: No bootstrap required, opened a new log
I20260811 19:01:00.928490 6402 tablet_bootstrap.cc:492] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41: No bootstrap required, opened a new log
I20260811 19:01:00.928503 6401 ts_tablet_manager.cc:1397] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 19:01:00.928540 6402 ts_tablet_manager.cc:1397] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 19:01:00.929908 6401 raft_consensus.cc:348] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:00.930052 6401 raft_consensus.cc:374] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:00.929955 6402 raft_consensus.cc:348] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:00.930084 6401 raft_consensus.cc:729] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1750db39714349729cb71c29275790bb, State: Initialized, Role: FOLLOWER
I20260811 19:01:00.930102 6402 raft_consensus.cc:374] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:00.930137 6402 raft_consensus.cc:729] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a01757ff5ab242f28d4470502e628b41, State: Initialized, Role: FOLLOWER
I20260811 19:01:00.930258 6401 consensus_queue.cc:260] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:00.930280 6402 consensus_queue.cc:260] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:00.930559 6401 ts_tablet_manager.cc:1428] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:01:00.930562 6383 heartbeater.cc:503] Master 127.5.226.126:35241 was elected leader, sending a full tablet report...
I20260811 19:01:00.930588 6165 heartbeater.cc:503] Master 127.5.226.126:35241 was elected leader, sending a full tablet report...
I20260811 19:01:00.930581 6402 ts_tablet_manager.cc:1428] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260811 19:01:01.011099 6166 tablet.cc:2369] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 19:01:01.124531 5899 tablet.cc:2369] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 19:01:01.142545 6385 tablet.cc:2369] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:01:01.194145 6413 raft_consensus.cc:482] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:01:01.194293 6413 raft_consensus.cc:504] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:01.194700 6413 leader_election.cc:288] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875), 22b89e4c494f4616b084b3e69e731b44 (127.5.226.65:42399)
I20260811 19:01:01.197665 6399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:01.194992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:55473 (local address 127.5.226.66:34875)
0811 19:01:01.195067 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:01.195069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:01.195080 (+ 11us) server_negotiation.cc:407] Connection header received
0811 19:01:01.195118 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:01.195119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:01.195131 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:01.195265 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:01.195480 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:01.195970 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:01.196914 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:01.197339 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:01.197402 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:01.197413 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:01.197555 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 19:01:01.197596 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 19:01:01.197674 6387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:01.194897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:34875 (local address 127.5.226.67:55473)
0811 19:01:01.194952 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:01.194965 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:01.195015 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:01.195300 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:01.195301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:01.195304 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:01.195397 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:01.195400 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:01.196053 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:01.196054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:01.196822 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:01.196825 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:01.197418 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:01.197419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:01.197497 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:01.197500 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:01:01.197542 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 19:01:01.197584 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":19}
I20260811 19:01:01.197772 6416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:01.195101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:38239 (local address 127.5.226.65:42399)
0811 19:01:01.195217 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:01.195219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:01.195301 (+ 82us) server_negotiation.cc:407] Connection header received
0811 19:01:01.195342 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:01.195343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:01.195373 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:01.195437 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:01.195587 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:01.196083 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:01.196981 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:01.197434 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:01.197506 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:01.197597 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:01.197657 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 19:01:01.197703 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":59,"threads_started":1}
I20260811 19:01:01.197779 6415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:01.195046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:42399 (local address 127.5.226.67:38239)
0811 19:01:01.195206 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:01.195214 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:01.195268 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:01.195454 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:01.195455 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:01.195457 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:01.195526 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:01.195528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:01.196164 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:01.196165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:01.196896 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:01.196898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:01.197519 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:01.197520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:01.197591 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:01.197595 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:01:01.197650 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 19:01:01.197691 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":97,"threads_started":1}
I20260811 19:01:01.198101 6082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9e1b05327484272a1c8fc0c65ea0c18" candidate_uuid: "1750db39714349729cb71c29275790bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a01757ff5ab242f28d4470502e628b41" is_pre_election: true
I20260811 19:01:01.198072 5825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9e1b05327484272a1c8fc0c65ea0c18" candidate_uuid: "1750db39714349729cb71c29275790bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22b89e4c494f4616b084b3e69e731b44" is_pre_election: true
I20260811 19:01:01.198252 6082 raft_consensus.cc:2454] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1750db39714349729cb71c29275790bb in term 0.
I20260811 19:01:01.198252 5825 raft_consensus.cc:2454] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1750db39714349729cb71c29275790bb in term 0.
I20260811 19:01:01.198495 6201 leader_election.cc:302] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1750db39714349729cb71c29275790bb, a01757ff5ab242f28d4470502e628b41; no voters:
I20260811 19:01:01.198637 6413 raft_consensus.cc:2781] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 19:01:01.198711 6413 raft_consensus.cc:482] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 19:01:01.198729 6413 raft_consensus.cc:3037] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:01.199507 6413 raft_consensus.cc:504] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:01.199728 6413 leader_election.cc:288] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [CANDIDATE]: Term 1 election: Requested vote from peers a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875), 22b89e4c494f4616b084b3e69e731b44 (127.5.226.65:42399)
I20260811 19:01:01.199803 6082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9e1b05327484272a1c8fc0c65ea0c18" candidate_uuid: "1750db39714349729cb71c29275790bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a01757ff5ab242f28d4470502e628b41"
I20260811 19:01:01.199903 6082 raft_consensus.cc:3037] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:01.199894 5825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9e1b05327484272a1c8fc0c65ea0c18" candidate_uuid: "1750db39714349729cb71c29275790bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22b89e4c494f4616b084b3e69e731b44"
I20260811 19:01:01.199991 5825 raft_consensus.cc:3037] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:01.200739 6082 raft_consensus.cc:2454] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1750db39714349729cb71c29275790bb in term 1.
I20260811 19:01:01.200866 5825 raft_consensus.cc:2454] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1750db39714349729cb71c29275790bb in term 1.
I20260811 19:01:01.200915 6201 leader_election.cc:302] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1750db39714349729cb71c29275790bb, a01757ff5ab242f28d4470502e628b41; no voters:
I20260811 19:01:01.200990 6413 raft_consensus.cc:2781] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:01.201155 6413 raft_consensus.cc:686] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [term 1 LEADER]: Becoming Leader. State: Replica: 1750db39714349729cb71c29275790bb, State: Running, Role: LEADER
I20260811 19:01:01.201267 6413 consensus_queue.cc:237] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:01.202119 5557 catalog_manager.cc:5495] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 1750db39714349729cb71c29275790bb (127.5.226.67). New cstate: current_term: 1 leader_uuid: "1750db39714349729cb71c29275790bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } health_report { overall_health: UNKNOWN } } }
I20260811 19:01:01.274683 6397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:01.272553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47452 (local address 127.5.226.67:39271)
0811 19:01:01.272616 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:01.272617 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:01.272626 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:01:01.272668 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:01.272669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:01.272691 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:01.272751 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:01:01.272868 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:01.273410 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:01.274078 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:01.274290 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:01.274341 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:01.274455 (+ 114us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:01:01.274506 (+ 51us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 19:01:01.274625 (+ 119us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47452: token expired
Metrics: {"server-negotiator.queue_time_us":35}
W20260811 19:01:01.274751 6397 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47452: token expired
I20260811 19:01:01.280364 5904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:01.275150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40944 (local address 127.5.226.126:35241)
0811 19:01:01.275220 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:01.275222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:01.275228 (+ 6us) server_negotiation.cc:407] Connection header received
0811 19:01:01.275247 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:01.275247 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:01.275255 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:01.275296 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:01.275760 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:01.276247 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:01.276878 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:01.277057 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:01.277106 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:01.278218 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:01.278219 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:01.278219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:01.278226 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:01.279491 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:01.279774 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:01.279775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:01.279776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:01.279823 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:01.279952 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:01.279952 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:01.279953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:01.280047 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:01.280115 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:01.280229 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 19:01:01.280296 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 19:01:01.283195 6397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:01.281175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47462 (local address 127.5.226.67:39271)
0811 19:01:01.281233 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:01.281235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:01.281243 (+ 8us) server_negotiation.cc:407] Connection header received
0811 19:01:01.281265 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:01.281266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:01.281277 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:01.281340 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:01:01.281438 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:01.281887 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:01.282534 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:01.282721 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:01.282774 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:01.282888 (+ 114us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:01:01.282989 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:01:01.283031 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:01.283095 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 19:01:01.283118 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 19:01:01.285061 6082 raft_consensus.cc:1261] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41 [term 1 FOLLOWER]: Refusing update from remote peer 1750db39714349729cb71c29275790bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:01:01.285063 5825 raft_consensus.cc:1261] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Refusing update from remote peer 1750db39714349729cb71c29275790bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:01:01.285386 6413 consensus_queue.cc:1035] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:01:01.285543 6417 consensus_queue.cc:1035] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:01:01.287966 6427 mvcc.cc:205] Tried to move back new op lower bound from 7317401031820795904 to 7317401031481028608. Current Snapshot: MvccSnapshot[applied={T|T < 7317401031820795904}]
I20260811 19:01:01.290162 5555 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:01:01.290268 5555 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:01:01.291010 5555 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Sending DeleteTablet for 3 replicas of tablet b9e1b05327484272a1c8fc0c65ea0c18
I20260811 19:01:01.291296 5792 tablet_service.cc:1514] Processing DeleteTablet for tablet b9e1b05327484272a1c8fc0c65ea0c18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:01 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:51442
I20260811 19:01:01.291298 6044 tablet_service.cc:1514] Processing DeleteTablet for tablet b9e1b05327484272a1c8fc0c65ea0c18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:01 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:44326
I20260811 19:01:01.291534 6442 tablet_replica.cc:330] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41: stopping tablet replica
I20260811 19:01:01.291559 6289 tablet_service.cc:1514] Processing DeleteTablet for tablet b9e1b05327484272a1c8fc0c65ea0c18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:01 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:47448
I20260811 19:01:01.291647 6442 raft_consensus.cc:2229] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:01:01.291769 6442 raft_consensus.cc:2258] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:01.291790 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 5620
I20260811 19:01:01.302734 6442 ts_tablet_manager.cc:1905] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:01.305794 6444 tablet_replica.cc:330] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb: stopping tablet replica
I20260811 19:01:01.305989 6444 raft_consensus.cc:2229] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [term 1 LEADER]: Raft consensus shutting down.
I20260811 19:01:01.306195 6444 raft_consensus.cc:2258] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:01.307714 6444 ts_tablet_manager.cc:1905] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:01.307808 6442 ts_tablet_manager.cc:1918] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:01.307967 6442 log.cc:1196] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/b9e1b05327484272a1c8fc0c65ea0c18
I20260811 19:01:01.308321 6442 ts_tablet_manager.cc:1939] T b9e1b05327484272a1c8fc0c65ea0c18 P a01757ff5ab242f28d4470502e628b41: Deleting consensus metadata
I20260811 19:01:01.308923 5519 catalog_manager.cc:4841] TS a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875): tablet b9e1b05327484272a1c8fc0c65ea0c18 (table test-table [id=1f732ab24577470dbe37dc6a1367f5ec]) successfully deleted
I20260811 19:01:01.309587 6444 ts_tablet_manager.cc:1918] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:01.309666 6444 log.cc:1196] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/b9e1b05327484272a1c8fc0c65ea0c18
I20260811 19:01:01.310037 6444 ts_tablet_manager.cc:1939] T b9e1b05327484272a1c8fc0c65ea0c18 P 1750db39714349729cb71c29275790bb: Deleting consensus metadata
I20260811 19:01:01.310504 5516 catalog_manager.cc:4841] TS 1750db39714349729cb71c29275790bb (127.5.226.67:39271): tablet b9e1b05327484272a1c8fc0c65ea0c18 (table test-table [id=1f732ab24577470dbe37dc6a1367f5ec]) successfully deleted
W20260811 19:01:01.312188 5519 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:42399 (error 108)
I20260811 19:01:01.312587 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 5907
I20260811 19:01:01.312722 6396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:01.312589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:42399 (local address 127.0.0.1:51450)
0811 19:01:01.312649 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:01.312689 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 19:01:01.315430 5519 catalog_manager.cc:4584] TS 22b89e4c494f4616b084b3e69e731b44 (127.5.226.65:42399): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b9e1b05327484272a1c8fc0c65ea0c18: Network error: Client connection negotiation failed: client connection to 127.5.226.65:42399: connect: Connection refused (error 111)
I20260811 19:01:01.360610 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 6168
I20260811 19:01:01.369620 6396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:01.369451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:42399 (local address 127.0.0.1:51452)
0811 19:01:01.369520 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:01.369571 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 19:01:01.370010 6396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:01.369913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:42399 (local address 127.0.0.1:51456)
0811 19:01:01.369956 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:01.369987 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 19:01:01.373894 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 5487
I20260811 19:01:21.383965 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:35241
--webserver_interface=127.5.226.126
--webserver_port=44813
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:35241
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:21.465485 6446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:21.465691 6446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:21.465713 6446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:21.466796 6446 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 19:01:21.466835 6446 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 19:01:21.466846 6446 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 19:01:21.466861 6446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:21.466873 6446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:21.466887 6446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:21.466902 6446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:21.466912 6446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:21.468346 6446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:35241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:35241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=44813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:21.468550 6446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:21.468724 6446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:21.473577 6454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:21.473583 6456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:21.473583 6453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:21.473645 6446 server_base.cc:1034] running on GCE node
I20260811 19:01:21.474048 6446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:21.474341 6446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:21.475482 6446 hybrid_clock.cc:648] HybridClock initialized: now 1786474881475466 us; error 30 us; skew 500 ppm
Aug 11 19:01:21 dist-test-slave-gjw7 krb5kdc[4426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474881, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:21.481724 6446 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:01:21.482194 6446 webserver.cc:460] Webserver started at http://127.5.226.126:44813/ using document root <none> and password file <none>
I20260811 19:01:21.482414 6446 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:21.482466 6446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:21.483772 6446 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:01:21.484390 6465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:21.484547 6446 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:21.484638 6446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "bfba7b47f08f4cb19a05028b8cf27957"
format_stamp: "Formatted at 2026-08-11 19:00:39 on dist-test-slave-gjw7"
server_key: "6202a4cfe0247cd2a6834e62a0fdd930"
server_key_iv: "fa7e664c223dfccdffb0704f6e006cfc"
server_key_version: "encryptionkey@0"
I20260811 19:01:21.485001 6446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:21.496865 6446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:21.498764 6446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:21.498909 6446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:21.502882 6446 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:35241
I20260811 19:01:21.502918 6569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:35241 every 8 connection(s)
I20260811 19:01:21.503279 6446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:21.504746 6571 sys_catalog.cc:263] Verifying existing consensus state
I20260811 19:01:21.505487 6571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Bootstrap starting.
I20260811 19:01:21.509608 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 6446
I20260811 19:01:21.509869 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:42399
--local_ip_for_outbound_sockets=127.5.226.65
--tserver_master_addrs=127.5.226.126:35241
--webserver_port=44693
--webserver_interface=127.5.226.65
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:01:21.514506 6571 log.cc:824] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:21.516707 6571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 19:01:21.517001 6571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Bootstrap complete.
I20260811 19:01:21.519193 6571 raft_consensus.cc:348] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } }
I20260811 19:01:21.519428 6571 raft_consensus.cc:729] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfba7b47f08f4cb19a05028b8cf27957, State: Initialized, Role: FOLLOWER
I20260811 19:01:21.519577 6571 consensus_queue.cc:260] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } }
I20260811 19:01:21.519646 6571 raft_consensus.cc:388] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:21.519688 6571 raft_consensus.cc:482] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:21.519735 6571 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 2 FOLLOWER]: Advancing to term 3
I20260811 19:01:21.520713 6571 raft_consensus.cc:504] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } }
I20260811 19:01:21.520808 6571 leader_election.cc:302] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bfba7b47f08f4cb19a05028b8cf27957; no voters:
I20260811 19:01:21.520985 6571 leader_election.cc:288] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 19:01:21.521055 6578 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 19:01:21.521238 6571 sys_catalog.cc:564] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:21.521270 6578 raft_consensus.cc:686] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [term 3 LEADER]: Becoming Leader. State: Replica: bfba7b47f08f4cb19a05028b8cf27957, State: Running, Role: LEADER
I20260811 19:01:21.521481 6578 consensus_queue.cc:237] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } }
I20260811 19:01:21.521754 6580 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "bfba7b47f08f4cb19a05028b8cf27957" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } } }
I20260811 19:01:21.521821 6580 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:21.522101 6581 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bfba7b47f08f4cb19a05028b8cf27957. Latest consensus state: current_term: 3 leader_uuid: "bfba7b47f08f4cb19a05028b8cf27957" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfba7b47f08f4cb19a05028b8cf27957" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35241 } } }
I20260811 19:01:21.522151 6581 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:21.522377 6591 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:21.523231 6591 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:21.523396 6591 catalog_manager.cc:1259] Loaded cluster ID: c5f69f4cd5e349988e9282b875e03620
I20260811 19:01:21.523643 6591 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:21.524936 6591 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:21.525130 6591 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Loaded TSK: 0
I20260811 19:01:21.525177 6591 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bfba7b47f08f4cb19a05028b8cf27957: Loaded TSK: 1
F20260811 19:01:21.525444 6591 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fbc885629ad google::LogMessage::Fail() at ??:0
@ 0x7fbc8856588a google::LogMessage::SendToLog() at ??:0
@ 0x7fbc885624de google::LogMessage::Flush() at ??:0
@ 0x7fbc88563a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fbc8accf104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fbc8acccd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fbc904bc1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fbc904bc48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fbc904bc594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fbc90482c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fbc9048cad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fbc8a4300d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fbc8a425954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fbc8b2896db start_thread at ??:0
@ 0x7fbc8706061f clone at ??:0
W20260811 19:01:21.606318 6575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:21.606515 6575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:21.606545 6575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:21.607684 6575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:21.607725 6575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:21.607759 6575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 19:01:21.609215 6575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:42399
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=44693
--tserver_master_addrs=127.5.226.126:35241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:21.609464 6575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:21.609678 6575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:21.615566 6649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:21.615566 6650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:21.615604 6653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:21.615782 6575 server_base.cc:1034] running on GCE node
I20260811 19:01:21.616056 6575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:21.616288 6575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:21.617435 6575 hybrid_clock.cc:648] HybridClock initialized: now 1786474881617423 us; error 37 us; skew 500 ppm
Aug 11 19:01:21 dist-test-slave-gjw7 krb5kdc[4426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474881, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:21.619848 6575 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 19:01:21.620306 6575 webserver.cc:460] Webserver started at http://127.5.226.65:44693/ using document root <none> and password file <none>
I20260811 19:01:21.620540 6575 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:21.620584 6575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:21.621937 6575 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:01:21.622577 6665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:21.622743 6575 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:21.622807 6575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "22b89e4c494f4616b084b3e69e731b44"
format_stamp: "Formatted at 2026-08-11 19:00:39 on dist-test-slave-gjw7"
server_key: "15233f9556a0b57b5ee869742ccb5cdd"
server_key_iv: "45da89f7371ba4b7563bf1343c23506f"
server_key_version: "encryptionkey@0"
I20260811 19:01:21.623167 6575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:21.642347 6575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:21.644560 6575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:21.644680 6575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:21.644917 6575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:21.645397 6680 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 19:01:21.647435 6575 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 19:01:21.647480 6575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 19:01:21.647512 6575 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 19:01:21.648154 6575 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 19:01:21.648187 6575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 19:01:21.648288 6680 tablet_bootstrap.cc:492] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44: Bootstrap starting.
I20260811 19:01:21.655006 6575 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:42399
I20260811 19:01:21.655395 6575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 19:01:21.655983 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 6575
I20260811 19:01:21.656287 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:34875
--local_ip_for_outbound_sockets=127.5.226.66
--tserver_master_addrs=127.5.226.126:35241
--webserver_port=46025
--webserver_interface=127.5.226.66
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:01:21.658551 6895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:42399 every 8 connection(s)
I20260811 19:01:21.659703 6680 log.cc:824] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:21.662560 6680 tablet_bootstrap.cc:492] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 19:01:21.662895 6680 tablet_bootstrap.cc:492] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44: Bootstrap complete.
I20260811 19:01:21.664158 6680 ts_tablet_manager.cc:1397] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.005s
I20260811 19:01:21.665658 6680 raft_consensus.cc:348] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:21.665997 6680 raft_consensus.cc:729] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b89e4c494f4616b084b3e69e731b44, State: Initialized, Role: FOLLOWER
I20260811 19:01:21.666190 6680 consensus_queue.cc:260] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:21.666500 6680 ts_tablet_manager.cc:1428] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
W20260811 19:01:21.735275 6904 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:01:21.656186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:33591)
0811 19:01:21.658772 (+ 2586us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:21.658815 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:21.659433 (+ 618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:21.735098 (+ 75665us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":2539,"thread_start_us":2142,"threads_started":1}
W20260811 19:01:21.735512 6896 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:35241 (0 consecutive failures): Network error: Failed to ping master at 127.5.226.126:35241: Client connection negotiation failed: client connection to 127.5.226.126:35241: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 19:01:21.735816 6904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:21.735710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:49053)
0811 19:01:21.735756 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:21.735796 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 19:01:21.736209 6904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:21.736126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:46477)
0811 19:01:21.736168 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:21.736192 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 19:01:21.736333 6896 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 19:01:21.746378 6901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:21.746575 6901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:21.746598 6901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:21.747694 6901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:21.747728 6901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:21.747751 6901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 19:01:21.749181 6901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:34875
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=46025
--tserver_master_addrs=127.5.226.126:35241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:21.749433 6901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:21.749637 6901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:21.754456 6923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:21.754431 6920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:21.754500 6901 server_base.cc:1034] running on GCE node
W20260811 19:01:21.754446 6921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:21.754838 6901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:21.755056 6901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:21.756192 6901 hybrid_clock.cc:648] HybridClock initialized: now 1786474881756181 us; error 28 us; skew 500 ppm
Aug 11 19:01:21 dist-test-slave-gjw7 krb5kdc[4426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474881, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:21.758560 6901 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 19:01:21.758989 6901 webserver.cc:460] Webserver started at http://127.5.226.66:46025/ using document root <none> and password file <none>
I20260811 19:01:21.759212 6901 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:21.759264 6901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:21.760558 6901 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:01:21.761102 6935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:21.761253 6901 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:21.761359 6901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "a01757ff5ab242f28d4470502e628b41"
format_stamp: "Formatted at 2026-08-11 19:00:40 on dist-test-slave-gjw7"
server_key: "7da9472f99119158b36f95d4ec03fa3e"
server_key_iv: "da2deba5d96041f5c7f3f35159775b03"
server_key_version: "encryptionkey@0"
I20260811 19:01:21.761703 6901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:21.783228 6901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:21.785063 6901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:21.785207 6901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:21.785480 6901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:21.785789 6901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:21.785825 6901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:21.785866 6901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:21.785890 6901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:21.791574 6901 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:34875
I20260811 19:01:21.791649 7149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:34875 every 8 connection(s)
I20260811 19:01:21.791961 6901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 19:01:21.793002 7153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:21.792574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:36505)
0811 19:01:21.792726 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:21.792796 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
I20260811 19:01:21.792999 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 6901
I20260811 19:01:21.793339 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:39271
--local_ip_for_outbound_sockets=127.5.226.67
--tserver_master_addrs=127.5.226.126:35241
--webserver_port=34329
--webserver_interface=127.5.226.67
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:21.793509 7151 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:35241 (0 consecutive failures): Network error: Failed to ping master at 127.5.226.126:35241: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
I20260811 19:01:21.793780 7153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:21.793681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:47495)
0811 19:01:21.793729 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:21.793760 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 19:01:21.794039 7153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:21.793962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:40569)
0811 19:01:21.794000 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:21.794022 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 19:01:21.794130 7151 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 19:01:21.874666 7156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:21.874863 7156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:21.874886 7156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:21.875972 7156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:21.876005 7156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:21.876029 7156 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 19:01:21.877441 7156 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:39271
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=34329
--tserver_master_addrs=127.5.226.126:35241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:21.877617 7156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:21.877794 7156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:21.883641 7181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:21.883646 7165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:21.884027 7166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:21.884114 7156 server_base.cc:1034] running on GCE node
I20260811 19:01:21.884382 7156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:21.884662 7156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:21.885803 7156 hybrid_clock.cc:648] HybridClock initialized: now 1786474881885785 us; error 33 us; skew 500 ppm
Aug 11 19:01:21 dist-test-slave-gjw7 krb5kdc[4426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474881, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:21.888625 7156 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 19:01:21.889051 7156 webserver.cc:460] Webserver started at http://127.5.226.67:34329/ using document root <none> and password file <none>
I20260811 19:01:21.889276 7156 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:21.889354 7156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:21.890661 7156 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:01:21.891240 7192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:21.891379 7156 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:21.891453 7156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "1750db39714349729cb71c29275790bb"
format_stamp: "Formatted at 2026-08-11 19:00:40 on dist-test-slave-gjw7"
server_key: "21a8a2b79a1e707b5d8ca5f8bcade3e6"
server_key_iv: "a0a3039907ada2154cfc861ed2d06079"
server_key_version: "encryptionkey@0"
I20260811 19:01:21.891800 7156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:21.910317 7156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:21.912161 7156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:21.912295 7156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:21.912511 7156 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:21.912806 7156 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:21.912839 7156 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:21.912868 7156 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:21.912885 7156 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:21.918395 7156 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:39271
I20260811 19:01:21.918462 7411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:39271 every 8 connection(s)
I20260811 19:01:21.918769 7156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 19:01:21.919759 7420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:21.919391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:59183)
0811 19:01:21.919548 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:21.919621 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
W20260811 19:01:21.920126 7415 heartbeater.cc:644] Failed to heartbeat to 127.5.226.126:35241 (0 consecutive failures): Network error: Failed to ping master at 127.5.226.126:35241: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
I20260811 19:01:21.920367 7420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:21.920282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:33311)
0811 19:01:21.920320 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:21.920344 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 19:01:21.920593 7420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:21.920522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:54857)
0811 19:01:21.920555 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:21.920575 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 19:01:21.920693 7415 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 19:01:21.928911 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 7156
I20260811 19:01:22.736949 7424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:22.736712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:45095)
0811 19:01:22.736835 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:22.736870 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":67,"threads_started":1}
I20260811 19:01:22.794668 7427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:22.794464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:52449)
0811 19:01:22.794576 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:22.794610 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":60,"threads_started":1}
I20260811 19:01:22.798844 7429 raft_consensus.cc:482] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:01:22.798957 7429 raft_consensus.cc:504] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:22.799291 7429 leader_election.cc:288] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875), 1750db39714349729cb71c29275790bb (127.5.226.67:39271)
Aug 11 19:01:22 dist-test-slave-gjw7 krb5kdc[4426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474881, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.66@KRBTEST.COM
Aug 11 19:01:22 dist-test-slave-gjw7 krb5kdc[4426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474881, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.67@KRBTEST.COM
I20260811 19:01:22.809711 7433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:22.799543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:45451 (local address 127.5.226.67:39271)
0811 19:01:22.799687 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:22.799699 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:22.799726 (+ 27us) server_negotiation.cc:407] Connection header received
0811 19:01:22.800279 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:22.800283 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:22.800346 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:22.800499 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:22.801218 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:22.802139 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:22.803148 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:22.803552 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:22.803651 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:22.806430 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:22.806433 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:22.806434 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:22.806444 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:22.808076 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:22.808414 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:22.808417 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:22.808418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:22.808521 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:22.808693 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:22.808693 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:22.808694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:22.808989 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:22.809078 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:22.809448 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 19:01:22.809595 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":51,"threads_started":1}
I20260811 19:01:22.809711 7434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:22.799546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:48921 (local address 127.5.226.66:34875)
0811 19:01:22.799687 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:22.799699 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:22.799728 (+ 29us) server_negotiation.cc:407] Connection header received
0811 19:01:22.800284 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:22.800287 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:22.800345 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:22.800499 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:22.801219 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:22.802109 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:22.803138 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:22.803552 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:22.803650 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:22.806081 (+ 2431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:22.806086 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:22.806087 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:22.806101 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:22.807856 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:22.808295 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:22.808298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:22.808299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:22.808404 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:22.808651 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:22.808652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:22.808652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:22.808989 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:22.809078 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:22.809448 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 19:01:22.809593 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":54,"threads_started":1}
I20260811 19:01:22.809700 7430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:22.799461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:39271 (local address 127.5.226.65:45451)
0811 19:01:22.799598 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:22.799608 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:22.799661 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:22.800629 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:22.800630 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:22.800893 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:22.801092 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:22.801099 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:22.802228 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:22.802229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:22.803049 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:22.803051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:22.803639 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:22.803640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:22.803748 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:22.804382 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:22.804386 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:22.806308 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:22.808149 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:22.808150 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:22.808151 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:22.808334 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:22.808579 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:22.808580 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:22.808580 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:22.808638 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:22.809058 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:22.809067 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:22.809241 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 19:01:22.809387 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 19:01:22.809583 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":81,"thread_start_us":68,"threads_started":1}
I20260811 19:01:22.809762 7424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:22.799435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:34875 (local address 127.5.226.65:48921)
0811 19:01:22.799493 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:22.799503 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:22.799557 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:22.800535 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:22.800538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:22.800897 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:22.801092 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:22.801099 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:22.802213 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:22.802214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:22.803051 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:22.803054 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:22.803642 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:22.803643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:22.803750 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:22.804333 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:22.804344 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:22.805962 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:22.807947 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:22.807954 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:22.807956 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:22.808208 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:22.808468 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:22.808468 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:22.808468 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:22.808588 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:22.809058 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:22.809067 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:22.809241 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 19:01:22.809387 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 19:01:22.809649 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":150}
W20260811 19:01:22.810632 6670 leader_election.cc:341] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875): Not found: Tablet not found: b9e1b05327484272a1c8fc0c65ea0c18
W20260811 19:01:22.810757 6667 leader_election.cc:341] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1750db39714349729cb71c29275790bb (127.5.226.67:39271): Not found: Tablet not found: b9e1b05327484272a1c8fc0c65ea0c18
I20260811 19:01:22.810811 6667 leader_election.cc:302] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22b89e4c494f4616b084b3e69e731b44; no voters: 1750db39714349729cb71c29275790bb, a01757ff5ab242f28d4470502e628b41
I20260811 19:01:22.810913 7429 raft_consensus.cc:2726] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 19:01:22.921175 7437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:22.920977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:56921)
0811 19:01:22.921091 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:22.921136 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":56,"threads_started":1}
I20260811 19:01:23.737638 7439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:23.737423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:54967)
0811 19:01:23.737545 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:23.737590 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":64,"threads_started":1}
I20260811 19:01:23.795284 7441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:23.795078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:59255)
0811 19:01:23.795200 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:23.795242 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":63,"threads_started":1}
I20260811 19:01:23.921797 7443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:23.921577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:39937)
0811 19:01:23.921697 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:23.921737 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":61,"threads_started":1}
I20260811 19:01:24.738322 7444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:24.738080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:60325)
0811 19:01:24.738226 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:24.738273 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":66,"threads_started":1}
I20260811 19:01:24.795923 7445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:24.795704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:54091)
0811 19:01:24.795824 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:24.795866 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
I20260811 19:01:24.868592 7447 raft_consensus.cc:482] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:01:24.868695 7447 raft_consensus.cc:504] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:24.868943 7447 leader_election.cc:288] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875), 1750db39714349729cb71c29275790bb (127.5.226.67:39271)
W20260811 19:01:24.869410 6667 leader_election.cc:341] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1750db39714349729cb71c29275790bb (127.5.226.67:39271): Not found: Tablet not found: b9e1b05327484272a1c8fc0c65ea0c18
W20260811 19:01:24.869529 6670 leader_election.cc:341] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875): Not found: Tablet not found: b9e1b05327484272a1c8fc0c65ea0c18
I20260811 19:01:24.869589 6670 leader_election.cc:302] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22b89e4c494f4616b084b3e69e731b44; no voters: 1750db39714349729cb71c29275790bb, a01757ff5ab242f28d4470502e628b41
I20260811 19:01:24.869680 7447 raft_consensus.cc:2726] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 19:01:24.922430 7448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:24.922221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:49573)
0811 19:01:24.922356 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:24.922392 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
I20260811 19:01:25.739065 7449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:25.738800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:37135)
0811 19:01:25.738969 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:25.739014 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":108,"threads_started":1}
I20260811 19:01:25.796531 7450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:25.796315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:43427)
0811 19:01:25.796451 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:25.796492 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":71,"threads_started":1}
I20260811 19:01:25.923050 7451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:25.922851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:52149)
0811 19:01:25.922969 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:25.923008 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":62,"threads_started":1}
I20260811 19:01:26.739813 7453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:26.739582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:46569)
0811 19:01:26.739724 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:26.739766 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
I20260811 19:01:26.797132 7454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:26.796937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:35957)
0811 19:01:26.797055 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:26.797091 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260811 19:01:26.923695 7457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:26.923485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:34553)
0811 19:01:26.923613 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:26.923655 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260811 19:01:27.740437 7458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:27.740228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:46277)
0811 19:01:27.740348 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:27.740387 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":64,"threads_started":1}
I20260811 19:01:27.797739 7459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:27.797552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:34711)
0811 19:01:27.797664 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:27.797700 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":62,"threads_started":1}
I20260811 19:01:27.924355 7460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:27.924147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:41117)
0811 19:01:27.924268 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:27.924309 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":68,"threads_started":1}
I20260811 19:01:28.060386 7462 raft_consensus.cc:482] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:01:28.060483 7462 raft_consensus.cc:504] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:28.060653 7462 leader_election.cc:288] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875), 1750db39714349729cb71c29275790bb (127.5.226.67:39271)
W20260811 19:01:28.061048 6670 leader_election.cc:341] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875): Not found: Tablet not found: b9e1b05327484272a1c8fc0c65ea0c18
W20260811 19:01:28.061117 6667 leader_election.cc:341] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1750db39714349729cb71c29275790bb (127.5.226.67:39271): Not found: Tablet not found: b9e1b05327484272a1c8fc0c65ea0c18
I20260811 19:01:28.061200 6667 leader_election.cc:302] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22b89e4c494f4616b084b3e69e731b44; no voters: 1750db39714349729cb71c29275790bb, a01757ff5ab242f28d4470502e628b41
I20260811 19:01:28.061311 7462 raft_consensus.cc:2726] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 19:01:28.741099 7466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:28.740845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:34701)
0811 19:01:28.741009 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:28.741048 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":73,"threads_started":1}
I20260811 19:01:28.798316 7468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:28.798095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:39933)
0811 19:01:28.798239 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:28.798275 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":82,"threads_started":1}
I20260811 19:01:28.925050 7470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:28.924784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:52407)
0811 19:01:28.924963 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:28.925003 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":108,"threads_started":1}
I20260811 19:01:29.741797 7477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:29.741579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:42513)
0811 19:01:29.741716 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:29.741750 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":84,"threads_started":1}
I20260811 19:01:29.798944 7478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:29.798704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:48031)
0811 19:01:29.798851 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:29.798897 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":62,"threads_started":1}
I20260811 19:01:29.925689 7479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:29.925491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:53945)
0811 19:01:29.925612 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:29.925647 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":67,"threads_started":1}
I20260811 19:01:29.980847 7482 raft_consensus.cc:482] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:01:29.980960 7482 raft_consensus.cc:504] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:29.981141 7482 leader_election.cc:288] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875), 1750db39714349729cb71c29275790bb (127.5.226.67:39271)
W20260811 19:01:29.981539 6667 leader_election.cc:341] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1750db39714349729cb71c29275790bb (127.5.226.67:39271): Not found: Tablet not found: b9e1b05327484272a1c8fc0c65ea0c18
W20260811 19:01:29.981629 6670 leader_election.cc:341] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875): Not found: Tablet not found: b9e1b05327484272a1c8fc0c65ea0c18
I20260811 19:01:29.981701 6670 leader_election.cc:302] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22b89e4c494f4616b084b3e69e731b44; no voters: 1750db39714349729cb71c29275790bb, a01757ff5ab242f28d4470502e628b41
I20260811 19:01:29.981815 7482 raft_consensus.cc:2726] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 19:01:30.742450 7484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:30.742212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:52235)
0811 19:01:30.742355 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:30.742402 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":69,"threads_started":1}
I20260811 19:01:30.799552 7486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:30.799350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:54415)
0811 19:01:30.799476 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:30.799509 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":59,"threads_started":1}
I20260811 19:01:30.926301 7489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:30.926033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:35865)
0811 19:01:30.926220 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:30.926258 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":83,"threads_started":1}
I20260811 19:01:31.743098 7490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:31.742886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:45621)
0811 19:01:31.743013 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:31.743049 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":69,"threads_started":1}
I20260811 19:01:31.800175 7492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:31.799959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:60273)
0811 19:01:31.800097 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:31.800129 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":83,"threads_started":1}
I20260811 19:01:31.926924 7498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:31.926680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:32951)
0811 19:01:31.926812 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:31.926856 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260811 19:01:32.743870 7499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:32.743606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:53645)
0811 19:01:32.743767 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:32.743816 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":75,"threads_started":1}
I20260811 19:01:32.800800 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:32.800577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:39407)
0811 19:01:32.800718 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:32.800755 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":83,"threads_started":1}
I20260811 19:01:32.927577 7502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:32.927328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:49929)
0811 19:01:32.927490 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:32.927529 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":77,"threads_started":1}
I20260811 19:01:33.207262 7503 raft_consensus.cc:482] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:01:33.207384 7503 raft_consensus.cc:504] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01757ff5ab242f28d4470502e628b41" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 34875 } } peers { permanent_uuid: "1750db39714349729cb71c29275790bb" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39271 } } peers { permanent_uuid: "22b89e4c494f4616b084b3e69e731b44" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42399 } }
I20260811 19:01:33.207564 7503 leader_election.cc:288] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875), 1750db39714349729cb71c29275790bb (127.5.226.67:39271)
W20260811 19:01:33.207907 6670 leader_election.cc:341] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a01757ff5ab242f28d4470502e628b41 (127.5.226.66:34875): Not found: Tablet not found: b9e1b05327484272a1c8fc0c65ea0c18
W20260811 19:01:33.208005 6667 leader_election.cc:341] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1750db39714349729cb71c29275790bb (127.5.226.67:39271): Not found: Tablet not found: b9e1b05327484272a1c8fc0c65ea0c18
I20260811 19:01:33.208050 6667 leader_election.cc:302] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22b89e4c494f4616b084b3e69e731b44; no voters: 1750db39714349729cb71c29275790bb, a01757ff5ab242f28d4470502e628b41
I20260811 19:01:33.208113 7503 raft_consensus.cc:2726] T b9e1b05327484272a1c8fc0c65ea0c18 P 22b89e4c494f4616b084b3e69e731b44 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 19:01:33.744527 7504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:33.744299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:46135)
0811 19:01:33.744446 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:33.744481 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":66,"threads_started":1}
I20260811 19:01:33.801491 7505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:33.801210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:57475)
0811 19:01:33.801404 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:33.801443 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":95,"threads_started":1}
I20260811 19:01:33.928238 7507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:33.928003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:45025)
0811 19:01:33.928153 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:33.928192 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":82,"threads_started":1}
I20260811 19:01:34.745205 7509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:34.744961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:54739)
0811 19:01:34.745118 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:34.745158 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":71,"threads_started":1}
I20260811 19:01:34.802161 7511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:34.801906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:59499)
0811 19:01:34.802061 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:34.802108 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":65,"threads_started":1}
I20260811 19:01:34.928906 7512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:34.928715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:58943)
0811 19:01:34.928825 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:34.928858 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":62,"threads_started":1}
I20260811 19:01:35.745915 7519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:35.745646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:56517)
0811 19:01:35.745811 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:35.745864 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":67,"threads_started":1}
I20260811 19:01:35.802819 7522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:35.802601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:51795)
0811 19:01:35.802731 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:35.802772 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":63,"threads_started":1}
I20260811 19:01:35.929641 7523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:35.929440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:58055)
0811 19:01:35.929554 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:35.929591 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":67,"threads_started":1}
I20260811 19:01:36.746645 7525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:36.746457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.65:60261)
0811 19:01:36.746569 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:36.746600 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
I20260811 19:01:36.803493 7526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:36.803289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.66:55521)
0811 19:01:36.803412 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:36.803447 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":63,"threads_started":1}
I20260811 19:01:36.930253 7529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:36.930074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35241 (local address 127.5.226.67:34047)
0811 19:01:36.930178 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:36.930212 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.126:35241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":58,"threads_started":1}
I20260811 19:01:36.931846 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 6575
I20260811 19:01:36.950577 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 6901
I20260811 19:01:36.963999 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 7156
2026-08-11T19:01:36Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58734 ms)
[----------] 30 tests from SecurityITest (236198 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:01:37 dist-test-slave-gjw7 krb5kdc[7535](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:01:37 dist-test-slave-gjw7 krb5kdc[7535](info): set up 2 sockets
Aug 11 19:01:37 dist-test-slave-gjw7 krb5kdc[7535](info): commencing operation
krb5kdc: starting...
W20260811 19:01:38.179102 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:01:38 dist-test-slave-gjw7 krb5kdc[7535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:01:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:01:38.295819 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:35685
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:35685
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:38.376878 7563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:38.377103 7563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:38.377133 7563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:38.378330 7563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:38.378381 7563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:38.378401 7563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:38.378417 7563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:38.378432 7563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:38.379931 7563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:35685
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:35685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:38.380188 7563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:38.380409 7563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 19:01:38.385349 7563 server_base.cc:1034] running on GCE node
W20260811 19:01:38.385355 7590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:38.385450 7588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:38.385378 7586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:38.385850 7563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:38.386145 7563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:38.387281 7563 hybrid_clock.cc:648] HybridClock initialized: now 1786474898387264 us; error 31 us; skew 500 ppm
Aug 11 19:01:38 dist-test-slave-gjw7 krb5kdc[7535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474898, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:38.389703 7563 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:01:38.390089 7563 webserver.cc:460] Webserver started at http://127.5.226.126:37411/ using document root <none> and password file <none>
I20260811 19:01:38.390311 7563 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:38.390369 7563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:38.390503 7563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:38.391534 7563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "888fa7c186e748daa50937be1ffed6cc"
format_stamp: "Formatted at 2026-08-11 19:01:38 on dist-test-slave-gjw7"
server_key: "252e99a46cb4425930e3184881620d85"
server_key_iv: "282fca1a824abe8b806c8f13f425c08a"
server_key_version: "encryptionkey@0"
I20260811 19:01:38.391865 7563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "888fa7c186e748daa50937be1ffed6cc"
format_stamp: "Formatted at 2026-08-11 19:01:38 on dist-test-slave-gjw7"
server_key: "252e99a46cb4425930e3184881620d85"
server_key_iv: "282fca1a824abe8b806c8f13f425c08a"
server_key_version: "encryptionkey@0"
I20260811 19:01:38.393093 7563 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:01:38.393808 7609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:38.393966 7563 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:38.394052 7563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "888fa7c186e748daa50937be1ffed6cc"
format_stamp: "Formatted at 2026-08-11 19:01:38 on dist-test-slave-gjw7"
server_key: "252e99a46cb4425930e3184881620d85"
server_key_iv: "282fca1a824abe8b806c8f13f425c08a"
server_key_version: "encryptionkey@0"
I20260811 19:01:38.394121 7563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:38.415943 7563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:38.418202 7563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:38.418342 7563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:38.422317 7563 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:35685
I20260811 19:01:38.422381 7706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:35685 every 8 connection(s)
I20260811 19:01:38.422705 7563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:38.423561 7707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:38.425918 7707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc: Bootstrap starting.
I20260811 19:01:38.426515 7707 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:38.426781 7707 log.cc:824] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:38.427446 7707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc: No bootstrap required, opened a new log
I20260811 19:01:38.429025 7707 raft_consensus.cc:348] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "888fa7c186e748daa50937be1ffed6cc" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35685 } }
I20260811 19:01:38.429167 7707 raft_consensus.cc:374] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:38.429201 7707 raft_consensus.cc:729] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 888fa7c186e748daa50937be1ffed6cc, State: Initialized, Role: FOLLOWER
I20260811 19:01:38.429386 7707 consensus_queue.cc:260] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "888fa7c186e748daa50937be1ffed6cc" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35685 } }
I20260811 19:01:38.429472 7707 raft_consensus.cc:388] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:38.429508 7707 raft_consensus.cc:482] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:38.429557 7707 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:38.430049 7707 raft_consensus.cc:504] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "888fa7c186e748daa50937be1ffed6cc" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35685 } }
I20260811 19:01:38.430141 7707 leader_election.cc:302] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 888fa7c186e748daa50937be1ffed6cc; no voters:
I20260811 19:01:38.430295 7707 leader_election.cc:288] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:38.430338 7713 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:38.430505 7713 raft_consensus.cc:686] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [term 1 LEADER]: Becoming Leader. State: Replica: 888fa7c186e748daa50937be1ffed6cc, State: Running, Role: LEADER
I20260811 19:01:38.430553 7707 sys_catalog.cc:564] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:38.430603 7713 consensus_queue.cc:237] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "888fa7c186e748daa50937be1ffed6cc" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35685 } }
I20260811 19:01:38.430902 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 7563
I20260811 19:01:38.431018 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:38.431228 6025 external_mini_cluster.cc:1428] Setting key 0f04b38e469e68731ac93262ab4827af
I20260811 19:01:38.431831 7715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "888fa7c186e748daa50937be1ffed6cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "888fa7c186e748daa50937be1ffed6cc" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35685 } } }
I20260811 19:01:38.431927 7715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:38.432134 7755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:38.432227 7720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 888fa7c186e748daa50937be1ffed6cc. Latest consensus state: current_term: 1 leader_uuid: "888fa7c186e748daa50937be1ffed6cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "888fa7c186e748daa50937be1ffed6cc" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 35685 } } }
I20260811 19:01:38.432446 7720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:38.432842 7755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:38.434269 7755 catalog_manager.cc:1347] Generated new cluster ID: 55d8c1b6a5874a86b5ea89ef7e6b9954
I20260811 19:01:38.434320 7755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 19:01:38 dist-test-slave-gjw7 krb5kdc[7535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:01:38.442602 7737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.431698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45340 (local address 127.5.226.126:35685)
0811 19:01:38.431896 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:38.431906 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:38.431943 (+ 37us) server_negotiation.cc:407] Connection header received
0811 19:01:38.432076 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:38.432085 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:38.432149 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:38.432315 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:38.433080 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.434478 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.435529 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.436211 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.436318 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.439106 (+ 2788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:38.439111 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:38.439111 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:38.439124 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:38.440960 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:38.441385 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:38.441388 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:38.441388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:38.441509 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:38.441702 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:38.441703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:38.441703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:38.441987 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:38.442123 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:38.442236 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 19:01:38.442378 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":87,"threads_started":1}
I20260811 19:01:38.449033 7755 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:38.449558 7755 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:38.454699 7755 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc: Generated new TSK 0
I20260811 19:01:38.454859 7755 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 19:01:38.483665 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35685
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:38.566042 7762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:38.566236 7762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:38.566257 7762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:38.567330 7762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:38.567363 7762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:38.567385 7762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 19:01:38.568773 7762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:38.568966 7762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:38.569139 7762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:38.573868 7779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:38.573889 7775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:38.573889 7771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:38.574147 7762 server_base.cc:1034] running on GCE node
I20260811 19:01:38.574348 7762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:38.574594 7762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:38.575734 7762 hybrid_clock.cc:648] HybridClock initialized: now 1786474898575718 us; error 32 us; skew 500 ppm
Aug 11 19:01:38 dist-test-slave-gjw7 krb5kdc[7535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474898, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:38.578179 7762 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 19:01:38.578584 7762 webserver.cc:460] Webserver started at http://127.5.226.65:45033/ using document root <none> and password file <none>
I20260811 19:01:38.578810 7762 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:38.578858 7762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:38.578994 7762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:38.580247 7762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "08f2310d729d48b380dd4f7c73924856"
format_stamp: "Formatted at 2026-08-11 19:01:38 on dist-test-slave-gjw7"
server_key: "fabc87a58a112d6fb9b7793c1977e74f"
server_key_iv: "a277d22d125f100768f1173ccc090678"
server_key_version: "encryptionkey@0"
I20260811 19:01:38.580579 7762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "08f2310d729d48b380dd4f7c73924856"
format_stamp: "Formatted at 2026-08-11 19:01:38 on dist-test-slave-gjw7"
server_key: "fabc87a58a112d6fb9b7793c1977e74f"
server_key_iv: "a277d22d125f100768f1173ccc090678"
server_key_version: "encryptionkey@0"
I20260811 19:01:38.581923 7762 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 19:01:38.582585 7805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:38.582728 7762 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:38.582811 7762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "08f2310d729d48b380dd4f7c73924856"
format_stamp: "Formatted at 2026-08-11 19:01:38 on dist-test-slave-gjw7"
server_key: "fabc87a58a112d6fb9b7793c1977e74f"
server_key_iv: "a277d22d125f100768f1173ccc090678"
server_key_version: "encryptionkey@0"
I20260811 19:01:38.582883 7762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:38.600618 7762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:38.602401 7762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:38.602538 7762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:38.602747 7762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:38.603050 7762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:38.603084 7762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:38.603114 7762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:38.603132 7762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:38.608664 7762 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:43731
I20260811 19:01:38.608723 8039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:43731 every 8 connection(s)
I20260811 19:01:38.609031 7762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 19:01:38.609179 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 7762
I20260811 19:01:38.609282 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 19:01:38.609541 6025 external_mini_cluster.cc:1428] Setting key d096ad8fa03b0745939d5316335dcd65
Aug 11 19:01:38 dist-test-slave-gjw7 krb5kdc[7535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474898, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
I20260811 19:01:38.618854 7737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.609822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:54501 (local address 127.5.226.126:35685)
0811 19:01:38.609902 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:38.609904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:38.610132 (+ 228us) server_negotiation.cc:407] Connection header received
0811 19:01:38.610724 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:38.610725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:38.610745 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:38.610804 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:38.611735 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.612343 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.613661 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.613878 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.613937 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.616193 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:38.616194 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:38.616195 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:38.616202 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:38.617512 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:38.617953 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:38.617953 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:38.617954 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:38.618001 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:38.618257 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:38.618257 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:38.618258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:38.618355 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:38.618401 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:38.618711 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 19:01:38.618776 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 19:01:38.619110 8042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.609793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35685 (local address 127.5.226.65:54501)
0811 19:01:38.609988 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:38.610042 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:38.610610 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:38.610865 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:38.610868 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:38.611448 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:38.611642 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.611647 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.612439 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.612440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.613579 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.613582 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.613953 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.613954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.614091 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.614564 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:38.614573 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:38.616096 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:38.617587 (+ 1491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:38.617595 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:38.617597 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:38.617885 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:38.618057 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:38.618058 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:38.618058 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:38.618197 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:38.618413 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:38.618421 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:38.618587 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 19:01:38.618700 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 19:01:38.618867 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":91,"threads_started":1}
I20260811 19:01:38.619592 8040 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35685
I20260811 19:01:38.619685 8040 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:38.619837 8040 heartbeater.cc:511] Master 127.5.226.126:35685 requested a full tablet report, sending...
I20260811 19:01:38.620361 7648 ts_manager.cc:194] Registered new tserver with Master: 08f2310d729d48b380dd4f7c73924856 (127.5.226.65:43731)
I20260811 19:01:38.621037 7648 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:54501
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 19:01:38.635273 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35685
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:38.717284 8046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:38.717531 8046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:38.717554 8046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:38.718647 8046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:38.718680 8046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:38.718705 8046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 19:01:38.720175 8046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:38.720381 8046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:38.720553 8046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:38.725378 8056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:38.725419 8055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:38.725363 8060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:38.725618 8046 server_base.cc:1034] running on GCE node
I20260811 19:01:38.725816 8046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:38.726014 8046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:38.727138 8046 hybrid_clock.cc:648] HybridClock initialized: now 1786474898727129 us; error 28 us; skew 500 ppm
Aug 11 19:01:38 dist-test-slave-gjw7 krb5kdc[7535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474898, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:38.729594 8046 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 19:01:38.729990 8046 webserver.cc:460] Webserver started at http://127.5.226.66:36111/ using document root <none> and password file <none>
I20260811 19:01:38.730183 8046 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:38.730221 8046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:38.730316 8046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:38.731412 8046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "d9659b4b639f4572bf4d448cb9402a3b"
format_stamp: "Formatted at 2026-08-11 19:01:38 on dist-test-slave-gjw7"
server_key: "c9f62a193cfeab823196e9491aeec64e"
server_key_iv: "e42daa9e14d22f8468ab12297f741d77"
server_key_version: "encryptionkey@0"
I20260811 19:01:38.731765 8046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "d9659b4b639f4572bf4d448cb9402a3b"
format_stamp: "Formatted at 2026-08-11 19:01:38 on dist-test-slave-gjw7"
server_key: "c9f62a193cfeab823196e9491aeec64e"
server_key_iv: "e42daa9e14d22f8468ab12297f741d77"
server_key_version: "encryptionkey@0"
I20260811 19:01:38.732963 8046 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 19:01:38.733664 8083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:38.733821 8046 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:38.733919 8046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "d9659b4b639f4572bf4d448cb9402a3b"
format_stamp: "Formatted at 2026-08-11 19:01:38 on dist-test-slave-gjw7"
server_key: "c9f62a193cfeab823196e9491aeec64e"
server_key_iv: "e42daa9e14d22f8468ab12297f741d77"
server_key_version: "encryptionkey@0"
I20260811 19:01:38.733976 8046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:38.743513 8046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:38.745548 8046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:38.745654 8046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:38.745827 8046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:38.746093 8046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:38.746122 8046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:38.746143 8046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:38.746160 8046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:38.751667 8046 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:36013
I20260811 19:01:38.751739 8300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:36013 every 8 connection(s)
I20260811 19:01:38.752025 8046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
Aug 11 19:01:38 dist-test-slave-gjw7 krb5kdc[7535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474898, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:01:38.760375 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 8046
I20260811 19:01:38.760495 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 19:01:38.760713 6025 external_mini_cluster.cc:1428] Setting key e3dc003316d481a81bbcc36330c4ec64
I20260811 19:01:38.760883 7737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.752731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:45389 (local address 127.5.226.126:35685)
0811 19:01:38.752793 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:38.752795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:38.752974 (+ 179us) server_negotiation.cc:407] Connection header received
0811 19:01:38.753544 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:38.753546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:38.753560 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:38.753612 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:38.754562 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.755071 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.756057 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.756256 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.756314 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.758317 (+ 2003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:38.758319 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:38.758319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:38.758327 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:38.759596 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:38.759968 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:38.759969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:38.759970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:38.760018 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:38.760205 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:38.760207 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:38.760207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:38.760350 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:38.760427 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:38.760706 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 19:01:38.760799 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 19:01:38.761025 8305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.752708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35685 (local address 127.5.226.66:45389)
0811 19:01:38.752857 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:38.752894 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:38.753433 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:38.753684 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:38.753688 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:38.754258 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:38.754460 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.754466 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.755158 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.755160 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.755965 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.755967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.756335 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.756336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.756452 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.756863 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:38.756872 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:38.758219 (+ 1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:38.759669 (+ 1450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:38.759676 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:38.759678 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:38.759910 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:38.760063 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:38.760063 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:38.760063 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:38.760157 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:38.760425 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:38.760428 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:38.760581 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 19:01:38.760666 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 19:01:38.760808 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":74,"threads_started":1}
I20260811 19:01:38.761603 8301 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35685
I20260811 19:01:38.761694 8301 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:38.761878 8301 heartbeater.cc:511] Master 127.5.226.126:35685 requested a full tablet report, sending...
I20260811 19:01:38.762264 7648 ts_manager.cc:194] Registered new tserver with Master: d9659b4b639f4572bf4d448cb9402a3b (127.5.226.66:36013)
I20260811 19:01:38.762622 7648 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:45389
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 19:01:38.786310 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35685
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:38.868975 8309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:38.869210 8309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:38.869232 8309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:38.870445 8309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:38.870492 8309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:38.870522 8309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 19:01:38.872057 8309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:35685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:38.872304 8309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:38.872521 8309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:38.877472 8320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:38.877509 8326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:38.877502 8323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:38.877672 8309 server_base.cc:1034] running on GCE node
I20260811 19:01:38.877876 8309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:38.878103 8309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:38.879244 8309 hybrid_clock.cc:648] HybridClock initialized: now 1786474898879231 us; error 31 us; skew 500 ppm
Aug 11 19:01:38 dist-test-slave-gjw7 krb5kdc[7535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474898, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:38.881901 8309 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 19:01:38.882336 8309 webserver.cc:460] Webserver started at http://127.5.226.67:46031/ using document root <none> and password file <none>
I20260811 19:01:38.882565 8309 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:38.882611 8309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:38.882745 8309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:38.883797 8309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "494d8685795445678e4130b92f584fd8"
format_stamp: "Formatted at 2026-08-11 19:01:38 on dist-test-slave-gjw7"
server_key: "23c254c176786620c2f3e2f6d5722899"
server_key_iv: "a7d76c115b350236557f07fa97e2caa9"
server_key_version: "encryptionkey@0"
I20260811 19:01:38.884138 8309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "494d8685795445678e4130b92f584fd8"
format_stamp: "Formatted at 2026-08-11 19:01:38 on dist-test-slave-gjw7"
server_key: "23c254c176786620c2f3e2f6d5722899"
server_key_iv: "a7d76c115b350236557f07fa97e2caa9"
server_key_version: "encryptionkey@0"
I20260811 19:01:38.885470 8309 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 19:01:38.886193 8338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:38.886348 8309 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:38.886444 8309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "494d8685795445678e4130b92f584fd8"
format_stamp: "Formatted at 2026-08-11 19:01:38 on dist-test-slave-gjw7"
server_key: "23c254c176786620c2f3e2f6d5722899"
server_key_iv: "a7d76c115b350236557f07fa97e2caa9"
server_key_version: "encryptionkey@0"
I20260811 19:01:38.886504 8309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:38.902079 8309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:38.904277 8309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:38.904428 8309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:38.904656 8309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:38.904963 8309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:38.904997 8309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:38.905028 8309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:38.905051 8309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:38.910737 8309 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:36209
I20260811 19:01:38.910812 8557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:36209 every 8 connection(s)
I20260811 19:01:38.911103 8309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 19:01:38.911563 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 8309
I20260811 19:01:38.911679 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 19:01:38.911886 6025 external_mini_cluster.cc:1428] Setting key 09e87eeb5c524c0ae8d9c8dcff5802b3
Aug 11 19:01:38 dist-test-slave-gjw7 krb5kdc[7535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474898, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:01:38.919834 7737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.911804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:44983 (local address 127.5.226.126:35685)
0811 19:01:38.911867 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:38.911869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:38.912115 (+ 246us) server_negotiation.cc:407] Connection header received
0811 19:01:38.912780 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:38.912781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:38.912793 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:38.912847 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:38.913812 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.914299 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.915212 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.915393 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.915436 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.917476 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:38.917478 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:38.917478 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:38.917485 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:38.918719 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:38.919076 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:38.919077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:38.919077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:38.919121 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:38.919315 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:38.919315 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:38.919315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:38.919423 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:38.919470 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:38.919709 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 19:01:38.919769 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 19:01:38.920046 8561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.911798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:35685 (local address 127.5.226.67:44983)
0811 19:01:38.911978 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:38.912025 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:38.912682 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:38.912916 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:38.912919 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:38.913529 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:38.913733 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.913738 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.914359 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.914359 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.915152 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.915154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.915445 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.915445 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.915552 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.916007 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:38.916016 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:38.917385 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:38.918791 (+ 1406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:38.918798 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:38.918800 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:38.919020 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:38.919163 (+ 143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:38.919163 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:38.919164 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:38.919278 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:38.919478 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:38.919485 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:38.919606 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 19:01:38.919691 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 19:01:38.919812 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":90,"threads_started":1}
I20260811 19:01:38.920519 8558 heartbeater.cc:347] Connected to a master server at 127.5.226.126:35685
I20260811 19:01:38.920609 8558 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:38.920758 8558 heartbeater.cc:511] Master 127.5.226.126:35685 requested a full tablet report, sending...
I20260811 19:01:38.921087 7648 ts_manager.cc:194] Registered new tserver with Master: 494d8685795445678e4130b92f584fd8 (127.5.226.67:36209)
I20260811 19:01:38.921502 7648 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:44983
I20260811 19:01:38.923545 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 19:01:38.930163 7737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.924839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45344 (local address 127.5.226.126:35685)
0811 19:01:38.924894 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:38.924896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:38.924979 (+ 83us) server_negotiation.cc:407] Connection header received
0811 19:01:38.925031 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:38.925032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:38.925040 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:38.925086 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:38.925686 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.926157 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.926877 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.927056 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.927105 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.928110 (+ 1005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:38.928111 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:38.928111 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:38.928117 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:38.929282 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:38.929570 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:38.929571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:38.929571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:38.929617 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:38.929741 (+ 124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:38.929741 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:38.929742 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:38.929876 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:38.929959 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:38.930046 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 19:01:38.930106 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 19:01:38.931689 7648 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45344:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 19:01:38.933406 7648 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 19:01:38.939508 8576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.935376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:36013 (local address 127.0.0.1:60208)
0811 19:01:38.935721 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:38.935730 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:38.935767 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:38.936295 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:38.936296 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:38.936298 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:38.936351 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.936353 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.937679 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.937680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.938578 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.938581 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.939243 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.939244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.939306 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.939311 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 19:01:38.939374 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 19:01:38.939418 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":56,"threads_started":1}
I20260811 19:01:38.939509 8578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.935481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60208 (local address 127.5.226.66:36013)
0811 19:01:38.936056 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:38.936060 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:38.936071 (+ 11us) server_negotiation.cc:407] Connection header received
0811 19:01:38.936112 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:38.936114 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:38.936129 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:38.936206 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:38.936451 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.937585 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.938654 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.939168 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.939238 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.939296 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:38.939388 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 19:01:38.939436 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":93,"threads_started":1}
I20260811 19:01:38.939582 8580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.935546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39404 (local address 127.5.226.67:36209)
0811 19:01:38.935722 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:38.935727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:38.935739 (+ 12us) server_negotiation.cc:407] Connection header received
0811 19:01:38.935780 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:38.935782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:38.935798 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:38.935913 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:38.936125 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.936987 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.938323 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.939050 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.939123 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.939180 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:38.939470 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 19:01:38.939514 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":79,"threads_started":1}
I20260811 19:01:38.939692 8579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.935556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:43731 (local address 127.0.0.1:50582)
0811 19:01:38.935750 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:38.935758 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:38.935794 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:38.936123 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:38.936124 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:38.936126 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:38.936162 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.936164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.937638 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.937639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.938648 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.938651 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.939512 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.939513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.939569 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.939573 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:01:38.939602 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 19:01:38.939636 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":55,"threads_started":1}
I20260811 19:01:38.939772 8575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.935369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:36209 (local address 127.0.0.1:39404)
0811 19:01:38.935534 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:38.935574 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:38.935634 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:38.935920 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:38.935924 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:38.935926 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:38.935999 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.936000 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.937078 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.937079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.938250 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.938253 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.939134 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.939135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.939227 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.939246 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 19:01:38.939310 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 19:01:38.939378 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":65,"threads_started":1}
I20260811 19:01:38.940040 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.935786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50582 (local address 127.5.226.65:43731)
0811 19:01:38.935965 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:38.935970 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:38.935981 (+ 11us) server_negotiation.cc:407] Connection header received
0811 19:01:38.936017 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:38.936019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:38.936033 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:38.936231 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:38.936308 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.937524 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.938744 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.939429 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.939826 (+ 397us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.939909 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:38.939936 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 19:01:38.939979 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":77,"threads_started":1}
I20260811 19:01:38.940644 8428 tablet_service.cc:1467] Processing CreateTablet for tablet 394f0813eb8e473596689361e9499f8d (DEFAULT_TABLE table=test-table [id=073e2350b18245beadf6b3b0b7941307]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:38.940662 7913 tablet_service.cc:1467] Processing CreateTablet for tablet 394f0813eb8e473596689361e9499f8d (DEFAULT_TABLE table=test-table [id=073e2350b18245beadf6b3b0b7941307]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:38.940794 8178 tablet_service.cc:1467] Processing CreateTablet for tablet 394f0813eb8e473596689361e9499f8d (DEFAULT_TABLE table=test-table [id=073e2350b18245beadf6b3b0b7941307]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:38.940932 8428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394f0813eb8e473596689361e9499f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:38.941006 7913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394f0813eb8e473596689361e9499f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:38.941068 8178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394f0813eb8e473596689361e9499f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:38.943558 8584 tablet_bootstrap.cc:492] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8: Bootstrap starting.
I20260811 19:01:38.944223 8584 tablet_bootstrap.cc:654] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:38.944257 8585 tablet_bootstrap.cc:492] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b: Bootstrap starting.
I20260811 19:01:38.944813 8584 log.cc:824] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:38.944900 8585 tablet_bootstrap.cc:654] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:38.945448 8585 log.cc:824] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:38.945627 8584 tablet_bootstrap.cc:492] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8: No bootstrap required, opened a new log
I20260811 19:01:38.945703 8584 ts_tablet_manager.cc:1397] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:01:38.945804 8586 tablet_bootstrap.cc:492] T 394f0813eb8e473596689361e9499f8d P 08f2310d729d48b380dd4f7c73924856: Bootstrap starting.
I20260811 19:01:38.946619 8586 tablet_bootstrap.cc:654] T 394f0813eb8e473596689361e9499f8d P 08f2310d729d48b380dd4f7c73924856: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:38.947176 8586 log.cc:824] T 394f0813eb8e473596689361e9499f8d P 08f2310d729d48b380dd4f7c73924856: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:38.947736 8585 tablet_bootstrap.cc:492] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b: No bootstrap required, opened a new log
I20260811 19:01:38.947805 8585 ts_tablet_manager.cc:1397] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 19:01:38.947705 8584 raft_consensus.cc:348] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9659b4b639f4572bf4d448cb9402a3b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36013 } } peers { permanent_uuid: "494d8685795445678e4130b92f584fd8" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36209 } } peers { permanent_uuid: "08f2310d729d48b380dd4f7c73924856" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43731 } }
I20260811 19:01:38.947865 8586 tablet_bootstrap.cc:492] T 394f0813eb8e473596689361e9499f8d P 08f2310d729d48b380dd4f7c73924856: No bootstrap required, opened a new log
I20260811 19:01:38.947908 8584 raft_consensus.cc:374] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:38.947932 8586 ts_tablet_manager.cc:1397] T 394f0813eb8e473596689361e9499f8d P 08f2310d729d48b380dd4f7c73924856: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:01:38.947954 8584 raft_consensus.cc:729] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 494d8685795445678e4130b92f584fd8, State: Initialized, Role: FOLLOWER
I20260811 19:01:38.948067 8584 consensus_queue.cc:260] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9659b4b639f4572bf4d448cb9402a3b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36013 } } peers { permanent_uuid: "494d8685795445678e4130b92f584fd8" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36209 } } peers { permanent_uuid: "08f2310d729d48b380dd4f7c73924856" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43731 } }
I20260811 19:01:38.948345 8584 ts_tablet_manager.cc:1428] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 19:01:38.948494 8558 heartbeater.cc:503] Master 127.5.226.126:35685 was elected leader, sending a full tablet report...
I20260811 19:01:38.949779 8585 raft_consensus.cc:348] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9659b4b639f4572bf4d448cb9402a3b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36013 } } peers { permanent_uuid: "494d8685795445678e4130b92f584fd8" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36209 } } peers { permanent_uuid: "08f2310d729d48b380dd4f7c73924856" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43731 } }
I20260811 19:01:38.949767 8586 raft_consensus.cc:348] T 394f0813eb8e473596689361e9499f8d P 08f2310d729d48b380dd4f7c73924856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9659b4b639f4572bf4d448cb9402a3b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36013 } } peers { permanent_uuid: "494d8685795445678e4130b92f584fd8" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36209 } } peers { permanent_uuid: "08f2310d729d48b380dd4f7c73924856" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43731 } }
I20260811 19:01:38.949966 8585 raft_consensus.cc:374] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:38.949985 8586 raft_consensus.cc:374] T 394f0813eb8e473596689361e9499f8d P 08f2310d729d48b380dd4f7c73924856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:38.950012 8585 raft_consensus.cc:729] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9659b4b639f4572bf4d448cb9402a3b, State: Initialized, Role: FOLLOWER
I20260811 19:01:38.950024 8586 raft_consensus.cc:729] T 394f0813eb8e473596689361e9499f8d P 08f2310d729d48b380dd4f7c73924856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08f2310d729d48b380dd4f7c73924856, State: Initialized, Role: FOLLOWER
I20260811 19:01:38.950127 8585 consensus_queue.cc:260] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9659b4b639f4572bf4d448cb9402a3b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36013 } } peers { permanent_uuid: "494d8685795445678e4130b92f584fd8" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36209 } } peers { permanent_uuid: "08f2310d729d48b380dd4f7c73924856" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43731 } }
I20260811 19:01:38.950151 8586 consensus_queue.cc:260] T 394f0813eb8e473596689361e9499f8d P 08f2310d729d48b380dd4f7c73924856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9659b4b639f4572bf4d448cb9402a3b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36013 } } peers { permanent_uuid: "494d8685795445678e4130b92f584fd8" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36209 } } peers { permanent_uuid: "08f2310d729d48b380dd4f7c73924856" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43731 } }
I20260811 19:01:38.950421 8301 heartbeater.cc:503] Master 127.5.226.126:35685 was elected leader, sending a full tablet report...
I20260811 19:01:38.950434 8586 ts_tablet_manager.cc:1428] T 394f0813eb8e473596689361e9499f8d P 08f2310d729d48b380dd4f7c73924856: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 19:01:38.950462 8585 ts_tablet_manager.cc:1428] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 19:01:38.950443 8040 heartbeater.cc:503] Master 127.5.226.126:35685 was elected leader, sending a full tablet report...
I20260811 19:01:38.964373 8600 raft_consensus.cc:482] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:01:38.964483 8600 raft_consensus.cc:504] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9659b4b639f4572bf4d448cb9402a3b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36013 } } peers { permanent_uuid: "494d8685795445678e4130b92f584fd8" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36209 } } peers { permanent_uuid: "08f2310d729d48b380dd4f7c73924856" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43731 } }
I20260811 19:01:38.964843 8600 leader_election.cc:288] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9659b4b639f4572bf4d448cb9402a3b (127.5.226.66:36013), 08f2310d729d48b380dd4f7c73924856 (127.5.226.65:43731)
I20260811 19:01:38.967665 8578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.965094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:48883 (local address 127.5.226.66:36013)
0811 19:01:38.965138 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:38.965140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:38.965147 (+ 7us) server_negotiation.cc:407] Connection header received
0811 19:01:38.965175 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:38.965176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:38.965185 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:38.965230 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:38.965402 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.966022 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.966950 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.967343 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.967407 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.967418 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:38.967555 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 19:01:38.967596 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 19:01:38.967693 8561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.964986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:36013 (local address 127.5.226.67:48883)
0811 19:01:38.965044 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:38.965058 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:38.965103 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:38.965242 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:38.965243 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:38.965245 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:38.965338 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.965341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.966100 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.966101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.966866 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.966868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.967414 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.967415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.967495 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.967498 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:01:38.967543 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 19:01:38.967588 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":20}
I20260811 19:01:38.967716 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.965117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:38309 (local address 127.5.226.65:43731)
0811 19:01:38.965163 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:38.965165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:38.965254 (+ 89us) server_negotiation.cc:407] Connection header received
0811 19:01:38.965329 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:38.965330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:38.965341 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:38.965386 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:38.965534 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.966124 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.967041 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.967415 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.967476 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.967485 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:38.967613 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 19:01:38.967650 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 19:01:38.967942 8606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.964995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:43731 (local address 127.5.226.67:38309)
0811 19:01:38.965191 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:38.965200 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:38.965255 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:38.965393 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:38.965394 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:38.965396 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:38.965466 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.965467 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.966196 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.966197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.966959 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:38.966961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.967483 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.967484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:38.967553 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.967557 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:01:38.967601 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 19:01:38.967639 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":12,"thread_start_us":114,"threads_started":1}
I20260811 19:01:38.968060 8214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "394f0813eb8e473596689361e9499f8d" candidate_uuid: "494d8685795445678e4130b92f584fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9659b4b639f4572bf4d448cb9402a3b" is_pre_election: true
I20260811 19:01:38.968223 8214 raft_consensus.cc:2454] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 494d8685795445678e4130b92f584fd8 in term 0.
I20260811 19:01:38.968247 7950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "394f0813eb8e473596689361e9499f8d" candidate_uuid: "494d8685795445678e4130b92f584fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08f2310d729d48b380dd4f7c73924856" is_pre_election: true
I20260811 19:01:38.968418 7950 raft_consensus.cc:2454] T 394f0813eb8e473596689361e9499f8d P 08f2310d729d48b380dd4f7c73924856 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 494d8685795445678e4130b92f584fd8 in term 0.
I20260811 19:01:38.968457 8346 leader_election.cc:302] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 494d8685795445678e4130b92f584fd8, d9659b4b639f4572bf4d448cb9402a3b; no voters:
I20260811 19:01:38.968581 8600 raft_consensus.cc:2781] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 19:01:38.968640 8600 raft_consensus.cc:482] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 19:01:38.968663 8600 raft_consensus.cc:3037] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:38.969439 8600 raft_consensus.cc:504] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9659b4b639f4572bf4d448cb9402a3b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36013 } } peers { permanent_uuid: "494d8685795445678e4130b92f584fd8" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36209 } } peers { permanent_uuid: "08f2310d729d48b380dd4f7c73924856" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43731 } }
I20260811 19:01:38.969574 8600 leader_election.cc:288] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [CANDIDATE]: Term 1 election: Requested vote from peers d9659b4b639f4572bf4d448cb9402a3b (127.5.226.66:36013), 08f2310d729d48b380dd4f7c73924856 (127.5.226.65:43731)
I20260811 19:01:38.969702 8214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "394f0813eb8e473596689361e9499f8d" candidate_uuid: "494d8685795445678e4130b92f584fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9659b4b639f4572bf4d448cb9402a3b"
I20260811 19:01:38.969732 7950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "394f0813eb8e473596689361e9499f8d" candidate_uuid: "494d8685795445678e4130b92f584fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08f2310d729d48b380dd4f7c73924856"
I20260811 19:01:38.969779 8214 raft_consensus.cc:3037] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:38.969800 7950 raft_consensus.cc:3037] T 394f0813eb8e473596689361e9499f8d P 08f2310d729d48b380dd4f7c73924856 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:38.970503 8214 raft_consensus.cc:2454] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 494d8685795445678e4130b92f584fd8 in term 1.
I20260811 19:01:38.970513 7950 raft_consensus.cc:2454] T 394f0813eb8e473596689361e9499f8d P 08f2310d729d48b380dd4f7c73924856 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 494d8685795445678e4130b92f584fd8 in term 1.
I20260811 19:01:38.970706 8339 leader_election.cc:302] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08f2310d729d48b380dd4f7c73924856, 494d8685795445678e4130b92f584fd8; no voters:
I20260811 19:01:38.970793 8600 raft_consensus.cc:2781] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:38.970945 8600 raft_consensus.cc:686] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 494d8685795445678e4130b92f584fd8, State: Running, Role: LEADER
I20260811 19:01:38.971029 8600 consensus_queue.cc:237] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9659b4b639f4572bf4d448cb9402a3b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36013 } } peers { permanent_uuid: "494d8685795445678e4130b92f584fd8" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36209 } } peers { permanent_uuid: "08f2310d729d48b380dd4f7c73924856" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43731 } }
I20260811 19:01:38.971841 7645 catalog_manager.cc:5495] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 494d8685795445678e4130b92f584fd8 (127.5.226.67). New cstate: current_term: 1 leader_uuid: "494d8685795445678e4130b92f584fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9659b4b639f4572bf4d448cb9402a3b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "494d8685795445678e4130b92f584fd8" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08f2310d729d48b380dd4f7c73924856" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43731 } health_report { overall_health: UNKNOWN } } }
I20260811 19:01:38.978036 8580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:38.975629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39420 (local address 127.5.226.67:36209)
0811 19:01:38.975678 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:38.975680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:38.975686 (+ 6us) server_negotiation.cc:407] Connection header received
0811 19:01:38.975717 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:38.975717 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:38.975733 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:38.975793 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:01:38.975920 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.976390 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.977223 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:38.977462 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:38.977511 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:38.977682 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:01:38.977793 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:01:38.977855 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:38.977937 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 19:01:38.977957 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 19:01:38.979938 8214 raft_consensus.cc:1261] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b [term 1 FOLLOWER]: Refusing update from remote peer 494d8685795445678e4130b92f584fd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:01:38.979939 7950 raft_consensus.cc:1261] T 394f0813eb8e473596689361e9499f8d P 08f2310d729d48b380dd4f7c73924856 [term 1 FOLLOWER]: Refusing update from remote peer 494d8685795445678e4130b92f584fd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:01:38.980291 8607 consensus_queue.cc:1035] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9659b4b639f4572bf4d448cb9402a3b" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:01:38.980420 8600 consensus_queue.cc:1035] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08f2310d729d48b380dd4f7c73924856" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 43731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:01:38.983000 8610 mvcc.cc:205] Tried to move back new op lower bound from 7317401186219098112 to 7317401186186027008. Current Snapshot: MvccSnapshot[applied={T|T < 7317401186219098112}]
I20260811 19:01:38.983702 8617 mvcc.cc:205] Tried to move back new op lower bound from 7317401186219098112 to 7317401186186027008. Current Snapshot: MvccSnapshot[applied={T|T < 7317401186219098112 or (T in {7317401186219098112})}]
I20260811 19:01:38.983970 8614 mvcc.cc:205] Tried to move back new op lower bound from 7317401186219098112 to 7317401186186027008. Current Snapshot: MvccSnapshot[applied={T|T < 7317401186219098112}]
I20260811 19:01:38.985610 7648 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:01:38.985700 7648 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:01:38.986506 7648 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 888fa7c186e748daa50937be1ffed6cc: Sending DeleteTablet for 3 replicas of tablet 394f0813eb8e473596689361e9499f8d
I20260811 19:01:38.986869 8178 tablet_service.cc:1514] Processing DeleteTablet for tablet 394f0813eb8e473596689361e9499f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:38 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:60208
I20260811 19:01:38.986887 8428 tablet_service.cc:1514] Processing DeleteTablet for tablet 394f0813eb8e473596689361e9499f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:38 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:39404
I20260811 19:01:38.987131 7913 tablet_service.cc:1514] Processing DeleteTablet for tablet 394f0813eb8e473596689361e9499f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:38 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:50582
I20260811 19:01:38.987170 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 7762
I20260811 19:01:39.000674 8630 tablet_replica.cc:330] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b: stopping tablet replica
I20260811 19:01:39.000862 8630 raft_consensus.cc:2229] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:01:39.001003 8630 raft_consensus.cc:2258] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:39.001190 8628 tablet_replica.cc:330] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8: stopping tablet replica
I20260811 19:01:39.001317 8628 raft_consensus.cc:2229] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 19:01:39.001438 8628 raft_consensus.cc:2258] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:39.001636 8630 ts_tablet_manager.cc:1905] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:39.001956 8628 ts_tablet_manager.cc:1905] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:39.003540 8630 ts_tablet_manager.cc:1918] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:39.003625 8630 log.cc:1196] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/394f0813eb8e473596689361e9499f8d
I20260811 19:01:39.003674 8628 ts_tablet_manager.cc:1918] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:39.003746 8628 log.cc:1196] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/394f0813eb8e473596689361e9499f8d
I20260811 19:01:39.003957 8630 ts_tablet_manager.cc:1939] T 394f0813eb8e473596689361e9499f8d P d9659b4b639f4572bf4d448cb9402a3b: Deleting consensus metadata
I20260811 19:01:39.004068 8628 ts_tablet_manager.cc:1939] T 394f0813eb8e473596689361e9499f8d P 494d8685795445678e4130b92f584fd8: Deleting consensus metadata
I20260811 19:01:39.004515 7619 catalog_manager.cc:4841] TS d9659b4b639f4572bf4d448cb9402a3b (127.5.226.66:36013): tablet 394f0813eb8e473596689361e9499f8d (table test-table [id=073e2350b18245beadf6b3b0b7941307]) successfully deleted
I20260811 19:01:39.005511 7610 catalog_manager.cc:4841] TS 494d8685795445678e4130b92f584fd8 (127.5.226.67:36209): tablet 394f0813eb8e473596689361e9499f8d (table test-table [id=073e2350b18245beadf6b3b0b7941307]) successfully deleted
W20260811 19:01:39.009791 7610 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:43731 (error 108)
I20260811 19:01:39.010022 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 8046
I20260811 19:01:39.010627 8575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.010205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:43731 (local address 127.0.0.1:50588)
0811 19:01:39.010553 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:39.010592 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:43731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326}
W20260811 19:01:39.012912 7610 catalog_manager.cc:4584] TS 08f2310d729d48b380dd4f7c73924856 (127.5.226.65:43731): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 394f0813eb8e473596689361e9499f8d: Network error: Client connection negotiation failed: client connection to 127.5.226.65:43731: connect: Connection refused (error 111)
I20260811 19:01:39.020330 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 8309
I20260811 19:01:39.063496 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 7563
2026-08-11T19:01:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2100 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T19:01:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:39Z Disabled control of system clock
I20260811 19:01:39.098730 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:37555
--webserver_interface=127.5.226.126
--webserver_port=0
--builtin_ntp_servers=127.5.226.84:35437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:37555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 19:01:39.182613 8637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:39.182858 8637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:39.182880 8637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:39.184054 8637 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:39.184101 8637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:39.184113 8637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:39.184125 8637 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:39.184135 8637 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:39.185573 8637 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:35437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:37555
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:37555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:39.185833 8637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:39.186141 8637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:39.190984 8652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:39.191107 8637 server_base.cc:1034] running on GCE node
W20260811 19:01:39.190976 8655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:39.191217 8651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:39.191550 8637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:39.191840 8637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:39.192983 8637 hybrid_clock.cc:648] HybridClock initialized: now 1786474899192970 us; error 31 us; skew 500 ppm
I20260811 19:01:39.197841 8637 webserver.cc:460] Webserver started at http://127.5.226.126:41707/ using document root <none> and password file <none>
I20260811 19:01:39.198098 8637 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:39.198153 8637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:39.198287 8637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:39.199390 8637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "f50144fa34ff47189417e9fbb071ceb6"
format_stamp: "Formatted at 2026-08-11 19:01:39 on dist-test-slave-gjw7"
server_key: "7569b286d99128cc35362b1514c05e21"
server_key_iv: "7fc0f3b1f50127fcdab3806caefc9efd"
server_key_version: "encryptionkey@0"
I20260811 19:01:39.199746 8637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "f50144fa34ff47189417e9fbb071ceb6"
format_stamp: "Formatted at 2026-08-11 19:01:39 on dist-test-slave-gjw7"
server_key: "7569b286d99128cc35362b1514c05e21"
server_key_iv: "7fc0f3b1f50127fcdab3806caefc9efd"
server_key_version: "encryptionkey@0"
I20260811 19:01:39.201013 8637 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 19:01:39.201817 8665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:39.201992 8637 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:39.202082 8637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "f50144fa34ff47189417e9fbb071ceb6"
format_stamp: "Formatted at 2026-08-11 19:01:39 on dist-test-slave-gjw7"
server_key: "7569b286d99128cc35362b1514c05e21"
server_key_iv: "7fc0f3b1f50127fcdab3806caefc9efd"
server_key_version: "encryptionkey@0"
I20260811 19:01:39.202152 8637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:39.212852 8637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:39.213191 8637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:39.213392 8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:39.217420 8637 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:37555
I20260811 19:01:39.217463 8766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:37555 every 8 connection(s)
I20260811 19:01:39.217821 8637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:39.220852 8770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:39.223282 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 8637
I20260811 19:01:39.223317 8770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6: Bootstrap starting.
I20260811 19:01:39.223382 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:39.223570 6025 external_mini_cluster.cc:1428] Setting key 5f4398acf3bb02e61f1c013f3eea740b
I20260811 19:01:39.224054 8770 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:39.224459 8770 log.cc:824] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:39.225358 8770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6: No bootstrap required, opened a new log
I20260811 19:01:39.227720 8770 raft_consensus.cc:348] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50144fa34ff47189417e9fbb071ceb6" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37555 } }
I20260811 19:01:39.227914 8770 raft_consensus.cc:374] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:39.227947 8770 raft_consensus.cc:729] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f50144fa34ff47189417e9fbb071ceb6, State: Initialized, Role: FOLLOWER
I20260811 19:01:39.228078 8770 consensus_queue.cc:260] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50144fa34ff47189417e9fbb071ceb6" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37555 } }
I20260811 19:01:39.228149 8770 raft_consensus.cc:388] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:39.228186 8770 raft_consensus.cc:482] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:39.228231 8770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:39.228969 8770 raft_consensus.cc:504] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50144fa34ff47189417e9fbb071ceb6" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37555 } }
I20260811 19:01:39.229095 8770 leader_election.cc:302] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f50144fa34ff47189417e9fbb071ceb6; no voters:
I20260811 19:01:39.229275 8770 leader_election.cc:288] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:39.229350 8782 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:39.229496 8782 raft_consensus.cc:686] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [term 1 LEADER]: Becoming Leader. State: Replica: f50144fa34ff47189417e9fbb071ceb6, State: Running, Role: LEADER
I20260811 19:01:39.229643 8782 consensus_queue.cc:237] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50144fa34ff47189417e9fbb071ceb6" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37555 } }
I20260811 19:01:39.229643 8770 sys_catalog.cc:564] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:39.229959 8777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.224080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48806 (local address 127.5.226.126:37555)
0811 19:01:39.224305 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:39.224316 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:39.224352 (+ 36us) server_negotiation.cc:407] Connection header received
0811 19:01:39.225038 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:39.225048 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:39.225132 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:39.225356 (+ 224us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:39.225594 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.226969 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.227698 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.228304 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.228440 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:39.229051 (+ 611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:39.229056 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:39.229056 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:39.229309 (+ 253us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:39.229356 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:39.229373 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:39.229473 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:39.229566 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 19:01:39.229759 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":87,"threads_started":1}
I20260811 19:01:39.230245 8783 sys_catalog.cc:455] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f50144fa34ff47189417e9fbb071ceb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50144fa34ff47189417e9fbb071ceb6" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37555 } } }
I20260811 19:01:39.230434 8783 sys_catalog.cc:458] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:39.230675 8784 sys_catalog.cc:455] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f50144fa34ff47189417e9fbb071ceb6. Latest consensus state: current_term: 1 leader_uuid: "f50144fa34ff47189417e9fbb071ceb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50144fa34ff47189417e9fbb071ceb6" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 37555 } } }
I20260811 19:01:39.230747 8784 sys_catalog.cc:458] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:39.230978 8799 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:39.231506 8799 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:39.233106 8799 catalog_manager.cc:1347] Generated new cluster ID: 34550517692640cbbb642dfc2e50ccc1
I20260811 19:01:39.233165 8799 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:39.258582 8799 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:39.259325 8799 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:39.269850 8799 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6: Generated new TSK 0
I20260811 19:01:39.270092 8799 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:01:39.276611 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:37555
--builtin_ntp_servers=127.5.226.84:35437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 19:01:39.361052 8818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:39.361334 8818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:39.361379 8818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:39.362653 8818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:39.362704 8818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:39.362744 8818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 19:01:39.364414 8818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:35437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:37555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:39.364689 8818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:39.365015 8818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:39.370031 8825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:39.370055 8827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:39.370031 8833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:39.370273 8818 server_base.cc:1034] running on GCE node
I20260811 19:01:39.370482 8818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:39.370712 8818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:39.371848 8818 hybrid_clock.cc:648] HybridClock initialized: now 1786474899371825 us; error 36 us; skew 500 ppm
I20260811 19:01:39.373034 8818 webserver.cc:460] Webserver started at http://127.5.226.65:36987/ using document root <none> and password file <none>
I20260811 19:01:39.373262 8818 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:39.373349 8818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:39.373471 8818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:39.374503 8818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "2ce21de53e4848cea7e316b598deb9cf"
format_stamp: "Formatted at 2026-08-11 19:01:39 on dist-test-slave-gjw7"
server_key: "7a1e48e904c4136dec906f690a428a97"
server_key_iv: "7eb881933be4b029ebab34b2956b3807"
server_key_version: "encryptionkey@0"
I20260811 19:01:39.374810 8818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "2ce21de53e4848cea7e316b598deb9cf"
format_stamp: "Formatted at 2026-08-11 19:01:39 on dist-test-slave-gjw7"
server_key: "7a1e48e904c4136dec906f690a428a97"
server_key_iv: "7eb881933be4b029ebab34b2956b3807"
server_key_version: "encryptionkey@0"
I20260811 19:01:39.375970 8818 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:01:39.376611 8844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:39.376742 8818 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:39.376837 8818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "2ce21de53e4848cea7e316b598deb9cf"
format_stamp: "Formatted at 2026-08-11 19:01:39 on dist-test-slave-gjw7"
server_key: "7a1e48e904c4136dec906f690a428a97"
server_key_iv: "7eb881933be4b029ebab34b2956b3807"
server_key_version: "encryptionkey@0"
I20260811 19:01:39.376909 8818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:39.390990 8818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:39.391309 8818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:39.391446 8818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:39.391677 8818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:39.392019 8818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:39.392055 8818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:39.392078 8818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:39.392102 8818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:39.397979 8818 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:36379
I20260811 19:01:39.398047 9073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:36379 every 8 connection(s)
I20260811 19:01:39.398406 8818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 19:01:39.402705 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 8818
I20260811 19:01:39.402803 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 19:01:39.402979 6025 external_mini_cluster.cc:1428] Setting key 503462c32eee3947c6ba45432068a0bd
I20260811 19:01:39.403586 8777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.399126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:59385 (local address 127.5.226.126:37555)
0811 19:01:39.399202 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:39.399204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:39.399440 (+ 236us) server_negotiation.cc:407] Connection header received
0811 19:01:39.399947 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:39.399949 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:39.399964 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:39.400006 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:39.400691 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.401199 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.402191 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.402391 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.402437 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:39.403304 (+ 867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:39.403306 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:39.403306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:39.403311 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:39.403327 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:39.403331 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:39.403395 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:39.403472 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 19:01:39.403509 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 19:01:39.403813 9079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.399107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:37555 (local address 127.5.226.65:59385)
0811 19:01:39.399322 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:39.399358 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:39.399856 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:39.400075 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:39.400079 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:39.400087 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:39.400619 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:39.400625 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.401261 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.401262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:39.402113 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:39.402117 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.402452 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.402452 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:39.402581 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:39.403162 (+ 581us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 19:01:39.403163 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:39.403195 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 19:01:39.403219 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:39.403398 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:39.403404 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:39.403408 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:01:39.403471 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 19:01:39.403581 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":93,"threads_started":1}
I20260811 19:01:39.403995 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:37555
--builtin_ntp_servers=127.5.226.84:35437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 19:01:39.404291 9076 heartbeater.cc:347] Connected to a master server at 127.5.226.126:37555
I20260811 19:01:39.404386 9076 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:39.404564 9076 heartbeater.cc:511] Master 127.5.226.126:37555 requested a full tablet report, sending...
I20260811 19:01:39.405066 8694 ts_manager.cc:194] Registered new tserver with Master: 2ce21de53e4848cea7e316b598deb9cf (127.5.226.65:36379)
I20260811 19:01:39.405748 8694 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.226.65:59385
W20260811 19:01:39.487161 9083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:39.487381 9083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:39.487401 9083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:39.488552 9083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:39.488592 9083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:39.488620 9083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 19:01:39.490015 9083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:35437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:37555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:39.490247 9083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:39.490543 9083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:39.495471 9094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:39.495507 9096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:39.495465 9101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:39.495651 9083 server_base.cc:1034] running on GCE node
I20260811 19:01:39.495841 9083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:39.496095 9083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:39.497237 9083 hybrid_clock.cc:648] HybridClock initialized: now 1786474899497225 us; error 29 us; skew 500 ppm
I20260811 19:01:39.498456 9083 webserver.cc:460] Webserver started at http://127.5.226.66:43501/ using document root <none> and password file <none>
I20260811 19:01:39.498680 9083 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:39.498730 9083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:39.498857 9083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:39.499938 9083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "8090f0e32ac7419a8d24e8ffe83b6f74"
format_stamp: "Formatted at 2026-08-11 19:01:39 on dist-test-slave-gjw7"
server_key: "b92442ed29244213befed06b2de972a0"
server_key_iv: "8ae422b5c573031b96715a314629d76a"
server_key_version: "encryptionkey@0"
I20260811 19:01:39.500283 9083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "8090f0e32ac7419a8d24e8ffe83b6f74"
format_stamp: "Formatted at 2026-08-11 19:01:39 on dist-test-slave-gjw7"
server_key: "b92442ed29244213befed06b2de972a0"
server_key_iv: "8ae422b5c573031b96715a314629d76a"
server_key_version: "encryptionkey@0"
I20260811 19:01:39.501533 9083 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 19:01:39.502199 9110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:39.502357 9083 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:39.502455 9083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "8090f0e32ac7419a8d24e8ffe83b6f74"
format_stamp: "Formatted at 2026-08-11 19:01:39 on dist-test-slave-gjw7"
server_key: "b92442ed29244213befed06b2de972a0"
server_key_iv: "8ae422b5c573031b96715a314629d76a"
server_key_version: "encryptionkey@0"
I20260811 19:01:39.502517 9083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:39.518297 9083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:39.518658 9083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:39.518811 9083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:39.519065 9083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:39.519446 9083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:39.519490 9083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:39.519526 9083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:39.519552 9083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:39.525830 9083 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:33049
I20260811 19:01:39.525868 9327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:33049 every 8 connection(s)
I20260811 19:01:39.526238 9083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 19:01:39.529690 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 9083
I20260811 19:01:39.529795 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 19:01:39.529997 6025 external_mini_cluster.cc:1428] Setting key 930e68c7030e683994d4fa4107c3588a
I20260811 19:01:39.531111 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:37555
--builtin_ntp_servers=127.5.226.84:35437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 19:01:39.531808 8777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.526991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:40231 (local address 127.5.226.126:37555)
0811 19:01:39.527056 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:39.527058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:39.527277 (+ 219us) server_negotiation.cc:407] Connection header received
0811 19:01:39.527789 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:39.527790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:39.527803 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:39.527852 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:39.528520 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.529023 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.530139 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.530434 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.530499 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:39.531547 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:39.531548 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:39.531549 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:39.531553 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:39.531569 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:39.531574 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:39.531615 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:39.531694 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 19:01:39.531718 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 19:01:39.532040 9334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.526964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:37555 (local address 127.5.226.66:40231)
0811 19:01:39.527163 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:39.527197 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:39.527694 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:39.527924 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:39.527928 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:39.527937 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:39.528434 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:39.528439 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.529150 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.529151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:39.530058 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:39.530061 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.530525 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.530526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:39.530707 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:39.531386 (+ 679us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 19:01:39.531387 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:39.531427 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 19:01:39.531457 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:39.531620 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:39.531624 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:39.531627 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:01:39.531701 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 19:01:39.531814 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":97,"threads_started":1}
I20260811 19:01:39.533228 9332 heartbeater.cc:347] Connected to a master server at 127.5.226.126:37555
I20260811 19:01:39.533353 9332 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:39.533555 9332 heartbeater.cc:511] Master 127.5.226.126:37555 requested a full tablet report, sending...
I20260811 19:01:39.533962 8694 ts_manager.cc:194] Registered new tserver with Master: 8090f0e32ac7419a8d24e8ffe83b6f74 (127.5.226.66:33049)
I20260811 19:01:39.534423 8694 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.226.66:40231
W20260811 19:01:39.614168 9336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:39.614378 9336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:39.614400 9336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:39.615504 9336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:39.615536 9336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:39.615559 9336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 19:01:39.617022 9336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:35437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:37555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:39.617244 9336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:39.617563 9336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:39.622406 9347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:39.622418 9346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:39.622551 9336 server_base.cc:1034] running on GCE node
W20260811 19:01:39.622476 9351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:39.622887 9336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:39.623123 9336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:39.624265 9336 hybrid_clock.cc:648] HybridClock initialized: now 1786474899624249 us; error 34 us; skew 500 ppm
I20260811 19:01:39.625530 9336 webserver.cc:460] Webserver started at http://127.5.226.67:44867/ using document root <none> and password file <none>
I20260811 19:01:39.625771 9336 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:39.625821 9336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:39.625960 9336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:39.627067 9336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "ed75701435474d8fa474eac212c2799f"
format_stamp: "Formatted at 2026-08-11 19:01:39 on dist-test-slave-gjw7"
server_key: "8d9f3fab8dd5c3c2ef72d93cef8a6903"
server_key_iv: "e5b5ac3525099546ad50d376eea225ee"
server_key_version: "encryptionkey@0"
I20260811 19:01:39.627406 9336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "ed75701435474d8fa474eac212c2799f"
format_stamp: "Formatted at 2026-08-11 19:01:39 on dist-test-slave-gjw7"
server_key: "8d9f3fab8dd5c3c2ef72d93cef8a6903"
server_key_iv: "e5b5ac3525099546ad50d376eea225ee"
server_key_version: "encryptionkey@0"
I20260811 19:01:39.628647 9336 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 19:01:39.629402 9361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:39.629565 9336 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:01:39.629655 9336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "ed75701435474d8fa474eac212c2799f"
format_stamp: "Formatted at 2026-08-11 19:01:39 on dist-test-slave-gjw7"
server_key: "8d9f3fab8dd5c3c2ef72d93cef8a6903"
server_key_iv: "e5b5ac3525099546ad50d376eea225ee"
server_key_version: "encryptionkey@0"
I20260811 19:01:39.629724 9336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:39.660789 9336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:39.661123 9336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:39.661259 9336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:39.661520 9336 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:39.661888 9336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:39.661926 9336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:39.661955 9336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:39.661972 9336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:39.667359 9336 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:40531
I20260811 19:01:39.667428 9569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:40531 every 8 connection(s)
I20260811 19:01:39.667738 9336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 19:01:39.672852 8777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.668463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:34139 (local address 127.5.226.126:37555)
0811 19:01:39.668523 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:39.668525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:39.668744 (+ 219us) server_negotiation.cc:407] Connection header received
0811 19:01:39.669279 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:39.669280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:39.669318 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:39.669373 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:39.670075 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.670575 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.671549 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.671744 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.671801 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:39.672581 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:39.672583 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:39.672584 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:39.672589 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:39.672607 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:39.672611 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:39.672656 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:39.672731 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 19:01:39.672760 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 19:01:39.673038 9578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.668426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:37555 (local address 127.5.226.67:34139)
0811 19:01:39.668628 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:39.668663 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:39.669175 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:39.669454 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:39.669458 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:39.669468 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:39.669981 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:39.669986 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.670666 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.670667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:39.671463 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:39.671465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.671821 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.671822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:39.671956 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:39.672445 (+ 489us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 19:01:39.672445 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:39.672476 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 19:01:39.672500 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:39.672660 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:39.672667 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:39.672670 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:01:39.672731 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 19:01:39.672838 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
I20260811 19:01:39.673525 9571 heartbeater.cc:347] Connected to a master server at 127.5.226.126:37555
I20260811 19:01:39.673617 9571 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:39.673795 9571 heartbeater.cc:511] Master 127.5.226.126:37555 requested a full tablet report, sending...
I20260811 19:01:39.674151 8694 ts_manager.cc:194] Registered new tserver with Master: ed75701435474d8fa474eac212c2799f (127.5.226.67:40531)
I20260811 19:01:39.674487 8694 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.226.67:34139
I20260811 19:01:39.677428 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 9336
I20260811 19:01:39.677515 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 19:01:39.677680 6025 external_mini_cluster.cc:1428] Setting key a7b51581a7ffe9e8c558f316c5a04329
I20260811 19:01:39.678470 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 19:01:39.682336 8777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.679771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59454 (local address 127.5.226.126:37555)
0811 19:01:39.679858 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:39.679860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:39.679965 (+ 105us) server_negotiation.cc:407] Connection header received
0811 19:01:39.680017 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:39.680018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:39.680027 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:39.680060 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:39.680202 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.680679 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.681410 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.681586 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.681633 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:39.682169 (+ 536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:39.682170 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:39.682170 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:39.682174 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:39.682187 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:39.682191 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:39.682227 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:39.682261 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 19:01:39.682280 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 19:01:39.683669 8694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59454:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 19:01:39.685168 8694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 19:01:39.691627 9593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.687241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50512 (local address 127.5.226.66:33049)
0811 19:01:39.687959 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:39.687963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:39.687972 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:01:39.688010 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:39.688011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:39.688025 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:39.688093 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:39.688272 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.688976 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.690457 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.691232 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.691308 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:39.691418 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:39.691506 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 19:01:39.691546 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":97,"threads_started":1}
I20260811 19:01:39.691622 9594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.687137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:40531 (local address 127.0.0.1:38256)
0811 19:01:39.687474 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:39.687511 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:39.687576 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:39.687842 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:39.687845 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:39.687848 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:39.687917 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:39.687919 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.689340 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.689342 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:39.690397 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:39.690399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.691325 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.691336 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:39.691408 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:39.691430 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 19:01:39.691469 (+ 39us) client_negotiation.cc:240] Negotiation successful
0811 19:01:39.691529 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":2,"thread_start_us":101,"threads_started":1}
I20260811 19:01:39.691627 9589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.687137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:33049 (local address 127.0.0.1:50512)
0811 19:01:39.687456 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:39.687505 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:39.687576 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:39.688162 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:39.688162 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:39.688164 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:39.688206 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:39.688208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.689056 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.689057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:39.690370 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:39.690373 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.691308 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.691308 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:39.691403 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:39.691420 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 19:01:39.691493 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 19:01:39.691540 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":35,"thread_start_us":57,"threads_started":1}
I20260811 19:01:39.692047 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.687242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38256 (local address 127.5.226.67:40531)
0811 19:01:39.687694 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:39.687698 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:39.687708 (+ 10us) server_negotiation.cc:407] Connection header received
0811 19:01:39.687741 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:39.687742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:39.687755 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:39.687821 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:39.688069 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.689231 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.690483 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.691232 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.691831 (+ 599us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:39.691910 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:39.691932 (+ 22us) server_negotiation.cc:299] Negotiation successful
0811 19:01:39.691969 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":90,"threads_started":1}
I20260811 19:01:39.692617 9588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.687353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:36379 (local address 127.0.0.1:51022)
0811 19:01:39.687474 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:39.687511 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:39.687576 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:39.687986 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:39.687987 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:39.687989 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:39.688021 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:39.688022 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.690475 (+ 2453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.690476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:39.691172 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:39.691174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.692408 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.692409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:39.692469 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:39.692473 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:01:39.692512 (+ 39us) client_negotiation.cc:240] Negotiation successful
0811 19:01:39.692552 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":75,"threads_started":1}
I20260811 19:01:39.692634 9597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:39.687469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51022 (local address 127.5.226.65:36379)
0811 19:01:39.687708 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:39.687711 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:39.687719 (+ 8us) server_negotiation.cc:407] Connection header received
0811 19:01:39.687751 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:39.687752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:39.687764 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:39.687917 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:39.688096 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.689238 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.691253 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:39.692336 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:39.692408 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:39.692494 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:39.692523 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 19:01:39.692556 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":95,"threads_started":1}
I20260811 19:01:39.692713 9458 tablet_service.cc:1467] Processing CreateTablet for tablet 08ba00ced4d645e386e7b6974a009da5 (DEFAULT_TABLE table=test-table [id=a0e6c4f533df435899bf0cb54d45e223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:39.693126 9458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ba00ced4d645e386e7b6974a009da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:39.693512 8942 tablet_service.cc:1467] Processing CreateTablet for tablet 08ba00ced4d645e386e7b6974a009da5 (DEFAULT_TABLE table=test-table [id=a0e6c4f533df435899bf0cb54d45e223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:39.693720 9201 tablet_service.cc:1467] Processing CreateTablet for tablet 08ba00ced4d645e386e7b6974a009da5 (DEFAULT_TABLE table=test-table [id=a0e6c4f533df435899bf0cb54d45e223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:39.693881 8942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ba00ced4d645e386e7b6974a009da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:39.694052 9201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ba00ced4d645e386e7b6974a009da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:39.695914 9598 tablet_bootstrap.cc:492] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f: Bootstrap starting.
I20260811 19:01:39.696587 9598 tablet_bootstrap.cc:654] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:39.696874 9598 log.cc:824] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:39.697160 9600 tablet_bootstrap.cc:492] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74: Bootstrap starting.
I20260811 19:01:39.697404 9599 tablet_bootstrap.cc:492] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf: Bootstrap starting.
I20260811 19:01:39.697639 9598 tablet_bootstrap.cc:492] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f: No bootstrap required, opened a new log
I20260811 19:01:39.697714 9598 ts_tablet_manager.cc:1397] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 19:01:39.697932 9600 tablet_bootstrap.cc:654] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:39.697988 9599 tablet_bootstrap.cc:654] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:39.698240 9600 log.cc:824] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:39.698256 9599 log.cc:824] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:39.699067 9599 tablet_bootstrap.cc:492] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf: No bootstrap required, opened a new log
I20260811 19:01:39.699146 9599 ts_tablet_manager.cc:1397] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 19:01:39.699455 9600 tablet_bootstrap.cc:492] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74: No bootstrap required, opened a new log
I20260811 19:01:39.699517 9600 ts_tablet_manager.cc:1397] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 19:01:39.700354 9598 raft_consensus.cc:348] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8090f0e32ac7419a8d24e8ffe83b6f74" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 33049 } } peers { permanent_uuid: "2ce21de53e4848cea7e316b598deb9cf" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36379 } } peers { permanent_uuid: "ed75701435474d8fa474eac212c2799f" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 40531 } }
I20260811 19:01:39.700539 9598 raft_consensus.cc:374] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:39.700578 9598 raft_consensus.cc:729] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed75701435474d8fa474eac212c2799f, State: Initialized, Role: FOLLOWER
I20260811 19:01:39.700817 9598 consensus_queue.cc:260] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8090f0e32ac7419a8d24e8ffe83b6f74" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 33049 } } peers { permanent_uuid: "2ce21de53e4848cea7e316b598deb9cf" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36379 } } peers { permanent_uuid: "ed75701435474d8fa474eac212c2799f" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 40531 } }
I20260811 19:01:39.701186 9598 ts_tablet_manager.cc:1428] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 19:01:39.701375 9571 heartbeater.cc:503] Master 127.5.226.126:37555 was elected leader, sending a full tablet report...
I20260811 19:01:39.701690 9600 raft_consensus.cc:348] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8090f0e32ac7419a8d24e8ffe83b6f74" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 33049 } } peers { permanent_uuid: "2ce21de53e4848cea7e316b598deb9cf" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36379 } } peers { permanent_uuid: "ed75701435474d8fa474eac212c2799f" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 40531 } }
I20260811 19:01:39.701850 9600 raft_consensus.cc:374] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:39.701892 9600 raft_consensus.cc:729] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8090f0e32ac7419a8d24e8ffe83b6f74, State: Initialized, Role: FOLLOWER
I20260811 19:01:39.701859 9599 raft_consensus.cc:348] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8090f0e32ac7419a8d24e8ffe83b6f74" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 33049 } } peers { permanent_uuid: "2ce21de53e4848cea7e316b598deb9cf" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36379 } } peers { permanent_uuid: "ed75701435474d8fa474eac212c2799f" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 40531 } }
I20260811 19:01:39.702018 9599 raft_consensus.cc:374] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:39.701998 9600 consensus_queue.cc:260] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8090f0e32ac7419a8d24e8ffe83b6f74" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 33049 } } peers { permanent_uuid: "2ce21de53e4848cea7e316b598deb9cf" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36379 } } peers { permanent_uuid: "ed75701435474d8fa474eac212c2799f" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 40531 } }
I20260811 19:01:39.702062 9599 raft_consensus.cc:729] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce21de53e4848cea7e316b598deb9cf, State: Initialized, Role: FOLLOWER
I20260811 19:01:39.702196 9599 consensus_queue.cc:260] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8090f0e32ac7419a8d24e8ffe83b6f74" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 33049 } } peers { permanent_uuid: "2ce21de53e4848cea7e316b598deb9cf" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36379 } } peers { permanent_uuid: "ed75701435474d8fa474eac212c2799f" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 40531 } }
I20260811 19:01:39.702240 9600 ts_tablet_manager.cc:1428] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 19:01:39.702349 9332 heartbeater.cc:503] Master 127.5.226.126:37555 was elected leader, sending a full tablet report...
I20260811 19:01:39.702457 9599 ts_tablet_manager.cc:1428] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 19:01:39.702574 9076 heartbeater.cc:503] Master 127.5.226.126:37555 was elected leader, sending a full tablet report...
W20260811 19:01:39.776814 9333 tablet.cc:2369] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 19:01:39.899076 9077 tablet.cc:2369] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 19:01:39.918339 9575 tablet.cc:2369] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:01:40.027170 9613 raft_consensus.cc:482] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:01:40.027328 9613 raft_consensus.cc:504] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8090f0e32ac7419a8d24e8ffe83b6f74" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 33049 } } peers { permanent_uuid: "2ce21de53e4848cea7e316b598deb9cf" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36379 } } peers { permanent_uuid: "ed75701435474d8fa474eac212c2799f" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 40531 } }
I20260811 19:01:40.027674 9613 leader_election.cc:288] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8090f0e32ac7419a8d24e8ffe83b6f74 (127.5.226.66:33049), ed75701435474d8fa474eac212c2799f (127.5.226.67:40531)
I20260811 19:01:40.031872 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:40.027952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:48823 (local address 127.5.226.67:40531)
0811 19:01:40.028005 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:40.028007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:40.028089 (+ 82us) server_negotiation.cc:407] Connection header received
0811 19:01:40.028158 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:40.028159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:40.028168 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:40.028231 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:40.028436 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:40.029214 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:40.030837 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:40.031413 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:40.031488 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:40.031498 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:40.031740 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 19:01:40.031784 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 19:01:40.031865 9593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:40.028014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:59649 (local address 127.5.226.66:33049)
0811 19:01:40.028057 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:40.028059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:40.028071 (+ 12us) server_negotiation.cc:407] Connection header received
0811 19:01:40.028158 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:40.028159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:40.028168 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:40.028231 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:40.028436 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:40.029205 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:40.030851 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:40.031413 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:40.031488 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:40.031498 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:40.031741 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 19:01:40.031784 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 19:01:40.031926 9616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:40.027888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:40531 (local address 127.5.226.65:48823)
0811 19:01:40.028017 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:40.028025 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:40.028087 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:40.028244 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:40.028245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:40.028248 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:40.028370 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:40.028372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:40.029325 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:40.029326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:40.030726 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:40.030731 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:40.031522 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:40.031524 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:40.031642 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:40.031650 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 19:01:40.031715 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 19:01:40.031765 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":62,"thread_start_us":65,"threads_started":1}
I20260811 19:01:40.031890 9615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:40.027867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:33049 (local address 127.5.226.65:59649)
0811 19:01:40.028010 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:40.028022 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:40.028087 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:40.028244 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:40.028245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:40.028246 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:40.028377 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:40.028378 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:40.029285 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:40.029309 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:40.030740 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:40.030742 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:40.031523 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:40.031524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:40.031642 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:40.031649 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 19:01:40.031715 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 19:01:40.031765 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":99,"thread_start_us":69,"threads_started":1}
I20260811 19:01:40.032315 9487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ba00ced4d645e386e7b6974a009da5" candidate_uuid: "2ce21de53e4848cea7e316b598deb9cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed75701435474d8fa474eac212c2799f" is_pre_election: true
I20260811 19:01:40.032521 9487 raft_consensus.cc:2454] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ce21de53e4848cea7e316b598deb9cf in term 0.
I20260811 19:01:40.032529 9233 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ba00ced4d645e386e7b6974a009da5" candidate_uuid: "2ce21de53e4848cea7e316b598deb9cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8090f0e32ac7419a8d24e8ffe83b6f74" is_pre_election: true
I20260811 19:01:40.032709 9233 raft_consensus.cc:2454] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ce21de53e4848cea7e316b598deb9cf in term 0.
I20260811 19:01:40.032799 8850 leader_election.cc:302] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce21de53e4848cea7e316b598deb9cf, ed75701435474d8fa474eac212c2799f; no voters:
I20260811 19:01:40.033026 9613 raft_consensus.cc:2781] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 19:01:40.033097 9613 raft_consensus.cc:482] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 19:01:40.033129 9613 raft_consensus.cc:3037] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:40.033947 9613 raft_consensus.cc:504] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8090f0e32ac7419a8d24e8ffe83b6f74" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 33049 } } peers { permanent_uuid: "2ce21de53e4848cea7e316b598deb9cf" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36379 } } peers { permanent_uuid: "ed75701435474d8fa474eac212c2799f" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 40531 } }
I20260811 19:01:40.034088 9613 leader_election.cc:288] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [CANDIDATE]: Term 1 election: Requested vote from peers 8090f0e32ac7419a8d24e8ffe83b6f74 (127.5.226.66:33049), ed75701435474d8fa474eac212c2799f (127.5.226.67:40531)
I20260811 19:01:40.034240 9487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ba00ced4d645e386e7b6974a009da5" candidate_uuid: "2ce21de53e4848cea7e316b598deb9cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed75701435474d8fa474eac212c2799f"
I20260811 19:01:40.034246 9233 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ba00ced4d645e386e7b6974a009da5" candidate_uuid: "2ce21de53e4848cea7e316b598deb9cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8090f0e32ac7419a8d24e8ffe83b6f74"
I20260811 19:01:40.034348 9233 raft_consensus.cc:3037] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:40.034345 9487 raft_consensus.cc:3037] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:40.035277 9233 raft_consensus.cc:2454] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce21de53e4848cea7e316b598deb9cf in term 1.
I20260811 19:01:40.035277 9487 raft_consensus.cc:2454] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce21de53e4848cea7e316b598deb9cf in term 1.
I20260811 19:01:40.035456 8852 leader_election.cc:302] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce21de53e4848cea7e316b598deb9cf, 8090f0e32ac7419a8d24e8ffe83b6f74; no voters:
I20260811 19:01:40.035579 9613 raft_consensus.cc:2781] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:40.035739 9613 raft_consensus.cc:686] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [term 1 LEADER]: Becoming Leader. State: Replica: 2ce21de53e4848cea7e316b598deb9cf, State: Running, Role: LEADER
I20260811 19:01:40.035837 9613 consensus_queue.cc:237] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8090f0e32ac7419a8d24e8ffe83b6f74" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 33049 } } peers { permanent_uuid: "2ce21de53e4848cea7e316b598deb9cf" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36379 } } peers { permanent_uuid: "ed75701435474d8fa474eac212c2799f" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 40531 } }
I20260811 19:01:40.036669 8694 catalog_manager.cc:5495] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ce21de53e4848cea7e316b598deb9cf (127.5.226.65). New cstate: current_term: 1 leader_uuid: "2ce21de53e4848cea7e316b598deb9cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8090f0e32ac7419a8d24e8ffe83b6f74" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 33049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ce21de53e4848cea7e316b598deb9cf" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 36379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed75701435474d8fa474eac212c2799f" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260811 19:01:40.047755 9597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:40.045689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51032 (local address 127.5.226.65:36379)
0811 19:01:40.045736 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:40.045738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:40.045746 (+ 8us) server_negotiation.cc:407] Connection header received
0811 19:01:40.045794 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:40.045795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:40.045813 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:40.045884 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:01:40.045984 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:40.046441 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:40.047159 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:40.047348 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:40.047403 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:40.047523 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:01:40.047619 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:01:40.047672 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:40.047684 (+ 12us) server_negotiation.cc:299] Negotiation successful
0811 19:01:40.047700 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 19:01:40.049535 9487 raft_consensus.cc:1261] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f [term 1 FOLLOWER]: Refusing update from remote peer 2ce21de53e4848cea7e316b598deb9cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:01:40.049566 9233 raft_consensus.cc:1261] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74 [term 1 FOLLOWER]: Refusing update from remote peer 2ce21de53e4848cea7e316b598deb9cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:01:40.049896 9617 consensus_queue.cc:1035] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed75701435474d8fa474eac212c2799f" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:01:40.050030 9613 consensus_queue.cc:1035] T 08ba00ced4d645e386e7b6974a009da5 P 2ce21de53e4848cea7e316b598deb9cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8090f0e32ac7419a8d24e8ffe83b6f74" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:01:40.052542 9628 mvcc.cc:205] Tried to move back new op lower bound from 7317401190600179712 to 7317401190547435520. Current Snapshot: MvccSnapshot[applied={T|T < 7317401190600179712}]
I20260811 19:01:40.055563 8693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:01:40.055675 8693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:01:40.056484 8693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f50144fa34ff47189417e9fbb071ceb6: Sending DeleteTablet for 3 replicas of tablet 08ba00ced4d645e386e7b6974a009da5
I20260811 19:01:40.056850 9458 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ba00ced4d645e386e7b6974a009da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:40 UTC) from {username='slave'} at 127.0.0.1:38256
I20260811 19:01:40.056856 9201 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ba00ced4d645e386e7b6974a009da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:40 UTC) from {username='slave'} at 127.0.0.1:50512
I20260811 19:01:40.056857 8942 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ba00ced4d645e386e7b6974a009da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:40 UTC) from {username='slave'} at 127.0.0.1:51022
I20260811 19:01:40.057178 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 8818
I20260811 19:01:40.057224 9650 tablet_replica.cc:330] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f: stopping tablet replica
I20260811 19:01:40.057689 9650 raft_consensus.cc:2229] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:01:40.057807 9650 raft_consensus.cc:2258] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:40.060379 9646 tablet_replica.cc:330] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74: stopping tablet replica
I20260811 19:01:40.060473 9646 raft_consensus.cc:2229] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:01:40.060563 9646 raft_consensus.cc:2258] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:40.062915 9646 ts_tablet_manager.cc:1905] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:40.062978 9650 ts_tablet_manager.cc:1905] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:40.064736 9650 ts_tablet_manager.cc:1918] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:40.064867 9650 log.cc:1196] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/08ba00ced4d645e386e7b6974a009da5
I20260811 19:01:40.064924 9646 ts_tablet_manager.cc:1918] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:40.065014 9646 log.cc:1196] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/08ba00ced4d645e386e7b6974a009da5
I20260811 19:01:40.065263 9650 ts_tablet_manager.cc:1939] T 08ba00ced4d645e386e7b6974a009da5 P ed75701435474d8fa474eac212c2799f: Deleting consensus metadata
I20260811 19:01:40.065335 9646 ts_tablet_manager.cc:1939] T 08ba00ced4d645e386e7b6974a009da5 P 8090f0e32ac7419a8d24e8ffe83b6f74: Deleting consensus metadata
I20260811 19:01:40.065790 8671 catalog_manager.cc:4841] TS ed75701435474d8fa474eac212c2799f (127.5.226.67:40531): tablet 08ba00ced4d645e386e7b6974a009da5 (table test-table [id=a0e6c4f533df435899bf0cb54d45e223]) successfully deleted
I20260811 19:01:40.065946 8672 catalog_manager.cc:4841] TS 8090f0e32ac7419a8d24e8ffe83b6f74 (127.5.226.66:33049): tablet 08ba00ced4d645e386e7b6974a009da5 (table test-table [id=a0e6c4f533df435899bf0cb54d45e223]) successfully deleted
W20260811 19:01:40.077405 8672 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:36379 (error 108)
I20260811 19:01:40.077749 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 9083
I20260811 19:01:40.080449 9588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:40.077891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:36379 (local address 127.0.0.1:51042)
0811 19:01:40.080357 (+ 2466us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:40.080409 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:36379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2440}
W20260811 19:01:40.085709 8672 catalog_manager.cc:4584] TS 2ce21de53e4848cea7e316b598deb9cf (127.5.226.65:36379): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 08ba00ced4d645e386e7b6974a009da5: Network error: Client connection negotiation failed: client connection to 127.5.226.65:36379: connect: Connection refused (error 111)
I20260811 19:01:40.096256 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 9336
I20260811 19:01:40.110849 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 8637
2026-08-11T19:01:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1052 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:01:40 dist-test-slave-gjw7 krb5kdc[9661](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:01:40 dist-test-slave-gjw7 krb5kdc[9661](info): set up 2 sockets
Aug 11 19:01:40 dist-test-slave-gjw7 krb5kdc[9661](info): commencing operation
krb5kdc: starting...
W20260811 19:01:41.334169 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:01:41 dist-test-slave-gjw7 krb5kdc[9661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:01:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:01:41.457891 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:43017
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:34163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:43017
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:41.539956 9687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:41.540170 9687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:41.540192 9687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:41.541285 9687 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:41.541368 9687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:41.541388 9687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:41.541404 9687 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:41.541419 9687 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:41.542984 9687 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:43017
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:43017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:41.543200 9687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:41.543390 9687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:41.548067 9695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:41.548100 9694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:41.548148 9697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:41.548184 9687 server_base.cc:1034] running on GCE node
I20260811 19:01:41.548556 9687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:41.548834 9687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:41.549980 9687 hybrid_clock.cc:648] HybridClock initialized: now 1786474901549962 us; error 35 us; skew 500 ppm
Aug 11 19:01:41 dist-test-slave-gjw7 krb5kdc[9661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474901, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:41.552291 9687 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:01:41.552744 9687 webserver.cc:460] Webserver started at http://127.5.226.126:32931/ using document root <none> and password file <none>
I20260811 19:01:41.552958 9687 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:41.553005 9687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:41.553131 9687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:41.554216 9687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "5db0b47c29304706a04895484d27cef8"
format_stamp: "Formatted at 2026-08-11 19:01:41 on dist-test-slave-gjw7"
server_key: "b257d2dc284c2180a75f3227ade00f48"
server_key_iv: "dc6c232871eaa4753fec831cacf81aa5"
server_key_version: "encryptionkey@0"
I20260811 19:01:41.554558 9687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "5db0b47c29304706a04895484d27cef8"
format_stamp: "Formatted at 2026-08-11 19:01:41 on dist-test-slave-gjw7"
server_key: "b257d2dc284c2180a75f3227ade00f48"
server_key_iv: "dc6c232871eaa4753fec831cacf81aa5"
server_key_version: "encryptionkey@0"
I20260811 19:01:41.555815 9687 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:01:41.556507 9708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:41.556655 9687 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:41.556742 9687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "5db0b47c29304706a04895484d27cef8"
format_stamp: "Formatted at 2026-08-11 19:01:41 on dist-test-slave-gjw7"
server_key: "b257d2dc284c2180a75f3227ade00f48"
server_key_iv: "dc6c232871eaa4753fec831cacf81aa5"
server_key_version: "encryptionkey@0"
I20260811 19:01:41.556808 9687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:41.578261 9687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:41.580116 9687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:41.580263 9687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:41.584492 9687 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:43017
I20260811 19:01:41.584532 9818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:43017 every 8 connection(s)
I20260811 19:01:41.584889 9687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:41.585781 9819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:41.588150 9819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8: Bootstrap starting.
I20260811 19:01:41.588750 9819 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:41.589033 9819 log.cc:824] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:41.589751 9819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8: No bootstrap required, opened a new log
I20260811 19:01:41.591357 9819 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5db0b47c29304706a04895484d27cef8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 43017 } }
I20260811 19:01:41.591506 9819 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:41.591528 9819 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5db0b47c29304706a04895484d27cef8, State: Initialized, Role: FOLLOWER
I20260811 19:01:41.591651 9819 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5db0b47c29304706a04895484d27cef8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 43017 } }
I20260811 19:01:41.591722 9819 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:41.591748 9819 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:41.591797 9819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:41.592319 9819 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5db0b47c29304706a04895484d27cef8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 43017 } }
I20260811 19:01:41.592420 9819 leader_election.cc:302] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5db0b47c29304706a04895484d27cef8; no voters:
I20260811 19:01:41.592573 9819 leader_election.cc:288] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:41.592613 9822 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:41.592756 9822 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [term 1 LEADER]: Becoming Leader. State: Replica: 5db0b47c29304706a04895484d27cef8, State: Running, Role: LEADER
I20260811 19:01:41.592796 9819 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:41.592842 9822 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5db0b47c29304706a04895484d27cef8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 43017 } }
I20260811 19:01:41.593022 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 9687
I20260811 19:01:41.593124 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:41.593371 6025 external_mini_cluster.cc:1428] Setting key 987df8f602660baa8d75180d87ca2562
I20260811 19:01:41.593426 9823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5db0b47c29304706a04895484d27cef8. Latest consensus state: current_term: 1 leader_uuid: "5db0b47c29304706a04895484d27cef8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5db0b47c29304706a04895484d27cef8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 43017 } } }
I20260811 19:01:41.593504 9823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:41.593817 9824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5db0b47c29304706a04895484d27cef8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5db0b47c29304706a04895484d27cef8" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 43017 } } }
I20260811 19:01:41.593883 9842 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:41.593891 9824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:41.594383 9842 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:41.595841 9842 catalog_manager.cc:1347] Generated new cluster ID: f6c6fb3a9d8a4bb89c332d4e56e3aa59
I20260811 19:01:41.595901 9842 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:41.602553 9842 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:41.603256 9842 catalog_manager.cc:1504] Loading token signing keys...
Aug 11 19:01:41 dist-test-slave-gjw7 krb5kdc[9661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:01:41.605091 9842 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8: Generated new TSK 0
I20260811 19:01:41.605233 9842 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:01:41.607900 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:41.594297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32916 (local address 127.5.226.126:43017)
0811 19:01:41.594487 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:41.594497 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:41.597601 (+ 3104us) server_negotiation.cc:407] Connection header received
0811 19:01:41.597735 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:41.597743 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:41.597802 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:41.597990 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:41.598718 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:41.600181 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:41.601195 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:41.601885 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:41.601998 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:41.604790 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:41.604795 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:41.604795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:41.604808 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:41.606488 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:41.606881 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:41.606883 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:41.606884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:41.606964 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:41.607131 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:41.607131 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:41.607131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:41.607330 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:41.607434 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:41.607559 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 19:01:41.607671 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":97,"threads_started":1}
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 19:01:41.634202 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:43017
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:34163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:41.721633 9864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:41.721859 9864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:41.721903 9864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:41.723094 9864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:41.723140 9864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:41.723176 9864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 19:01:41.724681 9864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:43017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:41.724931 9864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:41.725153 9864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:41.730149 9872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:41.730137 9876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:41.730137 9879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:41.730343 9864 server_base.cc:1034] running on GCE node
I20260811 19:01:41.730535 9864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:41.730731 9864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:41.731859 9864 hybrid_clock.cc:648] HybridClock initialized: now 1786474901731848 us; error 31 us; skew 500 ppm
Aug 11 19:01:41 dist-test-slave-gjw7 krb5kdc[9661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474901, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:41.734333 9864 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 19:01:41.734774 9864 webserver.cc:460] Webserver started at http://127.5.226.65:39335/ using document root <none> and password file <none>
I20260811 19:01:41.734979 9864 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:41.735023 9864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:41.735150 9864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:41.736222 9864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "3dca142f3917437391f753447280d13d"
format_stamp: "Formatted at 2026-08-11 19:01:41 on dist-test-slave-gjw7"
server_key: "e829a694461eb1f69f4d9d6c3a24853d"
server_key_iv: "0b740ae0e9ff4f05821e7ff99af6b396"
server_key_version: "encryptionkey@0"
I20260811 19:01:41.736554 9864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "3dca142f3917437391f753447280d13d"
format_stamp: "Formatted at 2026-08-11 19:01:41 on dist-test-slave-gjw7"
server_key: "e829a694461eb1f69f4d9d6c3a24853d"
server_key_iv: "0b740ae0e9ff4f05821e7ff99af6b396"
server_key_version: "encryptionkey@0"
I20260811 19:01:41.737854 9864 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 19:01:41.738526 9903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:41.738659 9864 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:41.738747 9864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "3dca142f3917437391f753447280d13d"
format_stamp: "Formatted at 2026-08-11 19:01:41 on dist-test-slave-gjw7"
server_key: "e829a694461eb1f69f4d9d6c3a24853d"
server_key_iv: "0b740ae0e9ff4f05821e7ff99af6b396"
server_key_version: "encryptionkey@0"
I20260811 19:01:41.738809 9864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:41.745374 9864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:41.747133 9864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:41.747274 9864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:41.747496 9864 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:41.747787 9864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:41.747819 9864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:41.747848 9864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:41.747881 9864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:41.753686 9864 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:40047
I20260811 19:01:41.753747 10144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:40047 every 8 connection(s)
I20260811 19:01:41.754061 9864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
Aug 11 19:01:41 dist-test-slave-gjw7 krb5kdc[9661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474901, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:01:41.760178 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 9864
I20260811 19:01:41.760304 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 19:01:41.760545 6025 external_mini_cluster.cc:1428] Setting key c2038cbe6c349bdcb567b746100eaf17
I20260811 19:01:41.763124 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:41.754768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:48771 (local address 127.5.226.126:43017)
0811 19:01:41.754834 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:41.754837 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:41.755007 (+ 170us) server_negotiation.cc:407] Connection header received
0811 19:01:41.755523 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:41.755525 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:41.755535 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:41.755571 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:41.756528 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:41.757029 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:41.757988 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:41.758179 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:41.758224 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:41.760251 (+ 2027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:41.760253 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:41.760253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:41.760262 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:41.761870 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:41.762242 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:41.762243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:41.762244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:41.762308 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:41.762509 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:41.762509 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:41.762510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:41.762636 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:41.762698 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:41.762938 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 19:01:41.763036 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 19:01:41.763499 10148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:41.754724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:43017 (local address 127.5.226.65:48771)
0811 19:01:41.754885 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:41.754929 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:41.755425 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:41.755635 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:41.755639 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:41.756230 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:41.756450 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:41.756455 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:41.757094 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:41.757095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:41.757916 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:41.757918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:41.758236 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:41.758237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:41.758330 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:41.758745 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:41.758754 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:41.760162 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:41.761946 (+ 1784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:41.761954 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:41.761956 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:41.762174 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:41.762363 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:41.762364 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:41.762364 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:41.762458 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:41.762688 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:41.762691 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:41.762798 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 19:01:41.762888 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 19:01:41.763325 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260811 19:01:41.763934 10145 heartbeater.cc:347] Connected to a master server at 127.5.226.126:43017
I20260811 19:01:41.764025 10145 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:41.764200 10145 heartbeater.cc:511] Master 127.5.226.126:43017 requested a full tablet report, sending...
I20260811 19:01:41.764743 9738 ts_manager.cc:194] Registered new tserver with Master: 3dca142f3917437391f753447280d13d (127.5.226.65:40047)
I20260811 19:01:41.765393 9738 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:48771
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 19:01:41.785981 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:43017
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:34163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:41.868654 10157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:41.868852 10157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:41.868875 10157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:41.870023 10157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:41.870066 10157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:41.870091 10157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 19:01:41.871555 10157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:43017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:41.871753 10157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:41.871943 10157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:41.876914 10169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:41.876906 10157 server_base.cc:1034] running on GCE node
W20260811 19:01:41.876915 10174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:41.876919 10171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:41.877393 10157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:41.877625 10157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:41.878762 10157 hybrid_clock.cc:648] HybridClock initialized: now 1786474901878747 us; error 28 us; skew 500 ppm
Aug 11 19:01:41 dist-test-slave-gjw7 krb5kdc[9661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474901, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:41.881824 10157 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 19:01:41.882417 10157 webserver.cc:460] Webserver started at http://127.5.226.66:40725/ using document root <none> and password file <none>
I20260811 19:01:41.882658 10157 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:41.882774 10157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:41.882922 10157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:41.884286 10157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "4ab80ced1fa34ff8a5323acafd24e646"
format_stamp: "Formatted at 2026-08-11 19:01:41 on dist-test-slave-gjw7"
server_key: "b2abb9769f1a5d0e8e1ec62df792e482"
server_key_iv: "44cb48966baf8c73f8a8345e22d429c7"
server_key_version: "encryptionkey@0"
I20260811 19:01:41.884701 10157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "4ab80ced1fa34ff8a5323acafd24e646"
format_stamp: "Formatted at 2026-08-11 19:01:41 on dist-test-slave-gjw7"
server_key: "b2abb9769f1a5d0e8e1ec62df792e482"
server_key_iv: "44cb48966baf8c73f8a8345e22d429c7"
server_key_version: "encryptionkey@0"
I20260811 19:01:41.886248 10157 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 19:01:41.887157 10192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:41.887336 10157 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 19:01:41.887437 10157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "4ab80ced1fa34ff8a5323acafd24e646"
format_stamp: "Formatted at 2026-08-11 19:01:41 on dist-test-slave-gjw7"
server_key: "b2abb9769f1a5d0e8e1ec62df792e482"
server_key_iv: "44cb48966baf8c73f8a8345e22d429c7"
server_key_version: "encryptionkey@0"
I20260811 19:01:41.887519 10157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:41.914696 10157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:41.916618 10157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:41.916772 10157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:41.917014 10157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:41.917382 10157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:41.917420 10157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:41.917452 10157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:41.917474 10157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:41.923039 10157 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:36151
I20260811 19:01:41.923098 10426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:36151 every 8 connection(s)
I20260811 19:01:41.923426 10157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
Aug 11 19:01:41 dist-test-slave-gjw7 krb5kdc[9661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474901, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:01:41.931629 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 10157
I20260811 19:01:41.931743 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 19:01:41.931984 6025 external_mini_cluster.cc:1428] Setting key 9881935cb5307724a434ec07ddb8cea8
I20260811 19:01:41.932376 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:41.924162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:58585 (local address 127.5.226.126:43017)
0811 19:01:41.924211 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:41.924213 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:41.924404 (+ 191us) server_negotiation.cc:407] Connection header received
0811 19:01:41.924891 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:41.924892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:41.924902 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:41.924954 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:41.925910 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:41.926399 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:41.927411 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:41.927600 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:41.927653 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:41.929706 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:41.929708 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:41.929708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:41.929716 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:41.930867 (+ 1151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:41.931316 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:41.931317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:41.931317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:41.931366 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:41.931599 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:41.931601 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:41.931601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:41.931748 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:41.931817 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:41.932175 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 19:01:41.932275 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 19:01:41.932554 10430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:41.924117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:43017 (local address 127.5.226.66:58585)
0811 19:01:41.924282 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:41.924324 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:41.924811 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:41.925017 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:41.925020 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:41.925631 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:41.925841 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:41.925846 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:41.926496 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:41.926497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:41.927332 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:41.927335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:41.927670 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:41.927671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:41.927769 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:41.928213 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:41.928222 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:41.929615 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:41.930986 (+ 1371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:41.930993 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:41.930995 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:41.931250 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:41.931409 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:41.931410 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:41.931410 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:41.931507 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:41.931842 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:41.931852 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:41.932024 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 19:01:41.932149 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 19:01:41.932309 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
I20260811 19:01:41.933094 10427 heartbeater.cc:347] Connected to a master server at 127.5.226.126:43017
I20260811 19:01:41.933228 10427 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:41.933444 10427 heartbeater.cc:511] Master 127.5.226.126:43017 requested a full tablet report, sending...
I20260811 19:01:41.933859 9738 ts_manager.cc:194] Registered new tserver with Master: 4ab80ced1fa34ff8a5323acafd24e646 (127.5.226.66:36151)
I20260811 19:01:41.934223 9738 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:58585
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 19:01:41.957819 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:43017
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:34163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:42.042588 10439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:42.042814 10439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:42.042837 10439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:42.044050 10439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:42.044090 10439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:42.044116 10439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 19:01:42.045629 10439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:34163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:43017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:42.045872 10439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:42.046084 10439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:42.050887 10453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:42.050912 10456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:42.051067 10439 server_base.cc:1034] running on GCE node
W20260811 19:01:42.050926 10458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:42.051337 10439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:42.051538 10439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:42.052667 10439 hybrid_clock.cc:648] HybridClock initialized: now 1786474902052652 us; error 31 us; skew 500 ppm
Aug 11 19:01:42 dist-test-slave-gjw7 krb5kdc[9661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474902, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:42.055132 10439 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 19:01:42.055557 10439 webserver.cc:460] Webserver started at http://127.5.226.67:46257/ using document root <none> and password file <none>
I20260811 19:01:42.055760 10439 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:42.055804 10439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:42.055948 10439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:42.056989 10439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "7e5ac894da094684993db7fe1e354510"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "ba203bcb36d464da9431f7094a2c3543"
server_key_iv: "076f7c772c968ce9f0553d5c3e61bde1"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.057364 10439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "7e5ac894da094684993db7fe1e354510"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "ba203bcb36d464da9431f7094a2c3543"
server_key_iv: "076f7c772c968ce9f0553d5c3e61bde1"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.058604 10439 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:01:42.059332 10473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:42.059499 10439 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:42.059583 10439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "7e5ac894da094684993db7fe1e354510"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "ba203bcb36d464da9431f7094a2c3543"
server_key_iv: "076f7c772c968ce9f0553d5c3e61bde1"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.059636 10439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:42.102365 10439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:42.104190 10439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:42.104303 10439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:42.104486 10439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:42.104799 10439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:42.104857 10439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:42.104904 10439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:42.104928 10439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:42.110668 10439 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:39795
I20260811 19:01:42.110723 10723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:39795 every 8 connection(s)
I20260811 19:01:42.111047 10439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 19:01:42.114099 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 10439
I20260811 19:01:42.114212 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 19:01:42.114403 6025 external_mini_cluster.cc:1428] Setting key 900a11e11cfe4ef0be1bdd2360061f69
Aug 11 19:01:42 dist-test-slave-gjw7 krb5kdc[9661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474902, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:01:42.120253 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.111738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:40975 (local address 127.5.226.126:43017)
0811 19:01:42.111797 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.111799 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.112021 (+ 222us) server_negotiation.cc:407] Connection header received
0811 19:01:42.112517 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.112518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.112527 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.112582 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:42.113564 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.114048 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.115436 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.115701 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.115755 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.117898 (+ 2143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:42.117900 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:42.117900 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:42.117907 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:42.119203 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:42.119538 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:42.119538 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:42.119539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:42.119585 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:42.119762 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:42.119763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:42.119763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:42.119861 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:42.119906 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.120119 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.120187 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 19:01:42.120451 10732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.111719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:43017 (local address 127.5.226.67:40975)
0811 19:01:42.111893 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:42.111939 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:42.112440 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:42.112641 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:42.112645 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:42.113218 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:42.113493 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.113499 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.114129 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.114130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.115365 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.115368 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.115771 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.115772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.115900 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.116346 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:42.116355 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:42.117797 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:42.119267 (+ 1470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:42.119271 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:42.119273 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:42.119484 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:42.119628 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:42.119628 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:42.119629 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:42.119722 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:42.119902 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:42.119905 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:42.120022 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 19:01:42.120101 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 19:01:42.120227 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":84,"threads_started":1}
I20260811 19:01:42.120905 10724 heartbeater.cc:347] Connected to a master server at 127.5.226.126:43017
I20260811 19:01:42.121012 10724 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:42.121203 10724 heartbeater.cc:511] Master 127.5.226.126:43017 requested a full tablet report, sending...
I20260811 19:01:42.121589 9738 ts_manager.cc:194] Registered new tserver with Master: 7e5ac894da094684993db7fe1e354510 (127.5.226.67:39795)
I20260811 19:01:42.121955 9738 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:40975
I20260811 19:01:42.126132 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 19:01:42.133275 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.127478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32926 (local address 127.5.226.126:43017)
0811 19:01:42.127539 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.127541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.127619 (+ 78us) server_negotiation.cc:407] Connection header received
0811 19:01:42.127680 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.127680 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.127692 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.127738 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:42.128278 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.128775 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.129540 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.129735 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.129785 (+ 50us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.131039 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:42.131041 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:42.131041 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:42.131049 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:42.132105 (+ 1056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:42.132483 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:42.132485 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:42.132485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:42.132542 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:42.132727 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:42.132727 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:42.132728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:42.132870 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:42.132964 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.133117 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.133179 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 19:01:42.134809 9738 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 19:01:42.136376 9738 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 19:01:42.142797 10753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.138712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38440 (local address 127.5.226.67:39795)
0811 19:01:42.138879 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.138884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.139115 (+ 231us) server_negotiation.cc:407] Connection header received
0811 19:01:42.139193 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.139196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.139211 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.139455 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:42.139534 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.140205 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.141598 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.142357 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.142427 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.142490 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.142673 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.142718 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260811 19:01:42.142781 10752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.138526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:39795 (local address 127.0.0.1:38440)
0811 19:01:42.139054 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:42.139063 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:42.139116 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:42.139308 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:42.139309 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:42.139311 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:42.139377 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.139379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.140298 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.140299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.141503 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.141506 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.142458 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.142459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.142561 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.142577 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 19:01:42.142645 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 19:01:42.142703 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":104,"threads_started":1}
I20260811 19:01:42.142920 10749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.138714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:36151 (local address 127.0.0.1:54692)
0811 19:01:42.139180 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:42.139186 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:42.139223 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:42.139607 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:42.139608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:42.139610 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:42.139645 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.139647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.140824 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.140832 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.141815 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.141818 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.142629 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.142630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.142683 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.142686 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:01:42.142727 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 19:01:42.142761 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":67,"threads_started":1}
I20260811 19:01:42.142948 10756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.138874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54692 (local address 127.5.226.66:36151)
0811 19:01:42.139034 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.139037 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.139375 (+ 338us) server_negotiation.cc:407] Connection header received
0811 19:01:42.139472 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.139475 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.139491 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.139553 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:42.139760 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.140741 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.141891 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.142475 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.142540 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.142596 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.142821 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.142861 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":91,"threads_started":1}
I20260811 19:01:42.142946 10751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.138669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43684 (local address 127.5.226.65:40047)
0811 19:01:42.138921 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.138924 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.139002 (+ 78us) server_negotiation.cc:407] Connection header received
0811 19:01:42.139126 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.139129 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.139146 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.139227 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:42.139417 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.140528 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.141789 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.142477 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.142532 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.142580 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.142825 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.142865 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":91,"threads_started":1}
I20260811 19:01:42.143115 10748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.138513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:40047 (local address 127.0.0.1:43684)
0811 19:01:42.138884 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:42.138929 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:42.139007 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:42.139238 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:42.139242 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:42.139243 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:42.139326 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.139333 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.140632 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.140633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.141705 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.141707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.142613 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.142615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.142676 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.142680 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:01:42.142727 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 19:01:42.142769 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":63,"threads_started":1}
I20260811 19:01:42.143642 10296 tablet_service.cc:1467] Processing CreateTablet for tablet 64139e935e79403484553d05d61b7166 (DEFAULT_TABLE table=test-table [id=745e15e12bec4f7cb4cfe50dd4083346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:42.143751 10009 tablet_service.cc:1467] Processing CreateTablet for tablet 64139e935e79403484553d05d61b7166 (DEFAULT_TABLE table=test-table [id=745e15e12bec4f7cb4cfe50dd4083346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:42.144042 10296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64139e935e79403484553d05d61b7166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:42.144042 10009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64139e935e79403484553d05d61b7166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:42.144062 10576 tablet_service.cc:1467] Processing CreateTablet for tablet 64139e935e79403484553d05d61b7166 (DEFAULT_TABLE table=test-table [id=745e15e12bec4f7cb4cfe50dd4083346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:42.144315 10576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64139e935e79403484553d05d61b7166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:42.146991 10757 tablet_bootstrap.cc:492] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510: Bootstrap starting.
I20260811 19:01:42.147342 10760 tablet_bootstrap.cc:492] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646: Bootstrap starting.
I20260811 19:01:42.147814 10757 tablet_bootstrap.cc:654] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:42.147989 10760 tablet_bootstrap.cc:654] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:42.148460 10757 log.cc:824] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:42.148535 10760 log.cc:824] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:42.148854 10761 tablet_bootstrap.cc:492] T 64139e935e79403484553d05d61b7166 P 3dca142f3917437391f753447280d13d: Bootstrap starting.
I20260811 19:01:42.149200 10757 tablet_bootstrap.cc:492] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510: No bootstrap required, opened a new log
I20260811 19:01:42.149266 10757 ts_tablet_manager.cc:1397] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:01:42.149467 10761 tablet_bootstrap.cc:654] T 64139e935e79403484553d05d61b7166 P 3dca142f3917437391f753447280d13d: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:42.149675 10760 tablet_bootstrap.cc:492] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646: No bootstrap required, opened a new log
I20260811 19:01:42.149746 10760 ts_tablet_manager.cc:1397] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 19:01:42.150002 10761 log.cc:824] T 64139e935e79403484553d05d61b7166 P 3dca142f3917437391f753447280d13d: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:42.150667 10761 tablet_bootstrap.cc:492] T 64139e935e79403484553d05d61b7166 P 3dca142f3917437391f753447280d13d: No bootstrap required, opened a new log
I20260811 19:01:42.150727 10761 ts_tablet_manager.cc:1397] T 64139e935e79403484553d05d61b7166 P 3dca142f3917437391f753447280d13d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 19:01:42.151257 10757 raft_consensus.cc:348] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dca142f3917437391f753447280d13d" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40047 } } peers { permanent_uuid: "7e5ac894da094684993db7fe1e354510" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39795 } } peers { permanent_uuid: "4ab80ced1fa34ff8a5323acafd24e646" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36151 } }
I20260811 19:01:42.151456 10757 raft_consensus.cc:374] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:42.151492 10757 raft_consensus.cc:729] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5ac894da094684993db7fe1e354510, State: Initialized, Role: FOLLOWER
I20260811 19:01:42.151618 10757 consensus_queue.cc:260] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dca142f3917437391f753447280d13d" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40047 } } peers { permanent_uuid: "7e5ac894da094684993db7fe1e354510" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39795 } } peers { permanent_uuid: "4ab80ced1fa34ff8a5323acafd24e646" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36151 } }
I20260811 19:01:42.151676 10760 raft_consensus.cc:348] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dca142f3917437391f753447280d13d" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40047 } } peers { permanent_uuid: "7e5ac894da094684993db7fe1e354510" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39795 } } peers { permanent_uuid: "4ab80ced1fa34ff8a5323acafd24e646" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36151 } }
I20260811 19:01:42.151839 10760 raft_consensus.cc:374] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:42.151885 10760 raft_consensus.cc:729] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab80ced1fa34ff8a5323acafd24e646, State: Initialized, Role: FOLLOWER
I20260811 19:01:42.151935 10757 ts_tablet_manager.cc:1428] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 19:01:42.152041 10760 consensus_queue.cc:260] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dca142f3917437391f753447280d13d" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40047 } } peers { permanent_uuid: "7e5ac894da094684993db7fe1e354510" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39795 } } peers { permanent_uuid: "4ab80ced1fa34ff8a5323acafd24e646" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36151 } }
I20260811 19:01:42.152089 10724 heartbeater.cc:503] Master 127.5.226.126:43017 was elected leader, sending a full tablet report...
I20260811 19:01:42.152310 10760 ts_tablet_manager.cc:1428] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 19:01:42.152429 10427 heartbeater.cc:503] Master 127.5.226.126:43017 was elected leader, sending a full tablet report...
I20260811 19:01:42.152503 10761 raft_consensus.cc:348] T 64139e935e79403484553d05d61b7166 P 3dca142f3917437391f753447280d13d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dca142f3917437391f753447280d13d" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40047 } } peers { permanent_uuid: "7e5ac894da094684993db7fe1e354510" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39795 } } peers { permanent_uuid: "4ab80ced1fa34ff8a5323acafd24e646" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36151 } }
I20260811 19:01:42.152627 10761 raft_consensus.cc:374] T 64139e935e79403484553d05d61b7166 P 3dca142f3917437391f753447280d13d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:42.152657 10761 raft_consensus.cc:729] T 64139e935e79403484553d05d61b7166 P 3dca142f3917437391f753447280d13d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dca142f3917437391f753447280d13d, State: Initialized, Role: FOLLOWER
I20260811 19:01:42.152760 10761 consensus_queue.cc:260] T 64139e935e79403484553d05d61b7166 P 3dca142f3917437391f753447280d13d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dca142f3917437391f753447280d13d" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40047 } } peers { permanent_uuid: "7e5ac894da094684993db7fe1e354510" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39795 } } peers { permanent_uuid: "4ab80ced1fa34ff8a5323acafd24e646" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36151 } }
I20260811 19:01:42.153047 10761 ts_tablet_manager.cc:1428] T 64139e935e79403484553d05d61b7166 P 3dca142f3917437391f753447280d13d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:01:42.153206 10145 heartbeater.cc:503] Master 127.5.226.126:43017 was elected leader, sending a full tablet report...
W20260811 19:01:42.174012 10429 tablet.cc:2369] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:01:42.175094 10772 raft_consensus.cc:482] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:01:42.175201 10772 raft_consensus.cc:504] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dca142f3917437391f753447280d13d" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40047 } } peers { permanent_uuid: "7e5ac894da094684993db7fe1e354510" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39795 } } peers { permanent_uuid: "4ab80ced1fa34ff8a5323acafd24e646" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36151 } }
I20260811 19:01:42.175585 10772 leader_election.cc:288] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dca142f3917437391f753447280d13d (127.5.226.65:40047), 4ab80ced1fa34ff8a5323acafd24e646 (127.5.226.66:36151)
I20260811 19:01:42.178277 10732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.175736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:40047 (local address 127.5.226.67:51113)
0811 19:01:42.175811 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:42.175823 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:42.175871 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:42.176046 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:42.176047 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:42.176048 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:42.176110 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.176112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.176714 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.176715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.177487 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.177489 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.178029 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.178030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.178112 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.178115 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:01:42.178160 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 19:01:42.178201 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":1}
I20260811 19:01:42.178277 10751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.175823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:51113 (local address 127.5.226.65:40047)
0811 19:01:42.175885 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.175886 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.175910 (+ 24us) server_negotiation.cc:407] Connection header received
0811 19:01:42.175940 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.175941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.175952 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.176004 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:42.176176 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.176642 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.177579 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.177960 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.178023 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.178034 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.178177 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.178214 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 19:01:42.178444 10756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.175961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:51595 (local address 127.5.226.66:36151)
0811 19:01:42.176016 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.176018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.176104 (+ 86us) server_negotiation.cc:407] Connection header received
0811 19:01:42.176156 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.176157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.176166 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.176208 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:42.176351 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.176814 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.177756 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.178134 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.178198 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.178206 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.178344 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.178388 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 19:01:42.178442 10778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.175858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:36151 (local address 127.5.226.67:51595)
0811 19:01:42.176044 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:42.176053 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:42.176103 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:42.176220 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:42.176220 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:42.176222 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:42.176296 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.176298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.176895 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.176896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.177675 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.177677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.178211 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.178212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.178279 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.178282 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:01:42.178328 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 19:01:42.178363 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":130,"threads_started":1}
I20260811 19:01:42.178655 10055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64139e935e79403484553d05d61b7166" candidate_uuid: "7e5ac894da094684993db7fe1e354510" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dca142f3917437391f753447280d13d" is_pre_election: true
I20260811 19:01:42.178819 10055 raft_consensus.cc:2454] T 64139e935e79403484553d05d61b7166 P 3dca142f3917437391f753447280d13d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5ac894da094684993db7fe1e354510 in term 0.
I20260811 19:01:42.179059 10482 leader_election.cc:302] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dca142f3917437391f753447280d13d, 7e5ac894da094684993db7fe1e354510; no voters:
I20260811 19:01:42.179186 10772 raft_consensus.cc:2781] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 19:01:42.179236 10772 raft_consensus.cc:482] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 19:01:42.179180 10333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64139e935e79403484553d05d61b7166" candidate_uuid: "7e5ac894da094684993db7fe1e354510" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab80ced1fa34ff8a5323acafd24e646" is_pre_election: true
I20260811 19:01:42.179251 10772 raft_consensus.cc:3037] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:42.179314 10333 raft_consensus.cc:2454] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5ac894da094684993db7fe1e354510 in term 0.
I20260811 19:01:42.180033 10772 raft_consensus.cc:504] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dca142f3917437391f753447280d13d" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40047 } } peers { permanent_uuid: "7e5ac894da094684993db7fe1e354510" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39795 } } peers { permanent_uuid: "4ab80ced1fa34ff8a5323acafd24e646" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36151 } }
I20260811 19:01:42.180150 10772 leader_election.cc:288] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [CANDIDATE]: Term 1 election: Requested vote from peers 3dca142f3917437391f753447280d13d (127.5.226.65:40047), 4ab80ced1fa34ff8a5323acafd24e646 (127.5.226.66:36151)
I20260811 19:01:42.180308 10055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64139e935e79403484553d05d61b7166" candidate_uuid: "7e5ac894da094684993db7fe1e354510" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dca142f3917437391f753447280d13d"
I20260811 19:01:42.180334 10333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64139e935e79403484553d05d61b7166" candidate_uuid: "7e5ac894da094684993db7fe1e354510" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab80ced1fa34ff8a5323acafd24e646"
I20260811 19:01:42.180388 10055 raft_consensus.cc:3037] T 64139e935e79403484553d05d61b7166 P 3dca142f3917437391f753447280d13d [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:42.180416 10333 raft_consensus.cc:3037] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:42.181111 10055 raft_consensus.cc:2454] T 64139e935e79403484553d05d61b7166 P 3dca142f3917437391f753447280d13d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5ac894da094684993db7fe1e354510 in term 1.
I20260811 19:01:42.181118 10333 raft_consensus.cc:2454] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5ac894da094684993db7fe1e354510 in term 1.
I20260811 19:01:42.181259 10482 leader_election.cc:302] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dca142f3917437391f753447280d13d, 7e5ac894da094684993db7fe1e354510; no voters:
I20260811 19:01:42.181370 10772 raft_consensus.cc:2781] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:42.181531 10772 raft_consensus.cc:686] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [term 1 LEADER]: Becoming Leader. State: Replica: 7e5ac894da094684993db7fe1e354510, State: Running, Role: LEADER
I20260811 19:01:42.181628 10772 consensus_queue.cc:237] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dca142f3917437391f753447280d13d" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40047 } } peers { permanent_uuid: "7e5ac894da094684993db7fe1e354510" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39795 } } peers { permanent_uuid: "4ab80ced1fa34ff8a5323acafd24e646" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36151 } }
I20260811 19:01:42.182446 9738 catalog_manager.cc:5495] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e5ac894da094684993db7fe1e354510 (127.5.226.67). New cstate: current_term: 1 leader_uuid: "7e5ac894da094684993db7fe1e354510" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dca142f3917437391f753447280d13d" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5ac894da094684993db7fe1e354510" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 39795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ab80ced1fa34ff8a5323acafd24e646" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36151 } health_report { overall_health: UNKNOWN } } }
I20260811 19:01:42.187091 10753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.185108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38450 (local address 127.5.226.67:39795)
0811 19:01:42.185151 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.185153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.185160 (+ 7us) server_negotiation.cc:407] Connection header received
0811 19:01:42.185217 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.185218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.185233 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.185284 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:01:42.185410 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.185854 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.186510 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.186677 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.186719 (+ 42us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.186807 (+ 88us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:01:42.186898 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:01:42.186962 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.186998 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.187007 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 19:01:42.188719 10333 raft_consensus.cc:1261] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646 [term 1 FOLLOWER]: Refusing update from remote peer 7e5ac894da094684993db7fe1e354510: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:01:42.188719 10055 raft_consensus.cc:1261] T 64139e935e79403484553d05d61b7166 P 3dca142f3917437391f753447280d13d [term 1 FOLLOWER]: Refusing update from remote peer 7e5ac894da094684993db7fe1e354510: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:01:42.189057 10784 consensus_queue.cc:1035] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dca142f3917437391f753447280d13d" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 40047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:01:42.189177 10772 consensus_queue.cc:1035] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab80ced1fa34ff8a5323acafd24e646" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:01:42.191905 10793 mvcc.cc:205] Tried to move back new op lower bound from 7317401199362650112 to 7317401199336603648. Current Snapshot: MvccSnapshot[applied={T|T < 7317401199362650112}]
I20260811 19:01:42.193706 9737 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:01:42.193794 9737 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:01:42.193531 10792 mvcc.cc:205] Tried to move back new op lower bound from 7317401199362650112 to 7317401199336603648. Current Snapshot: MvccSnapshot[applied={T|T < 7317401199362650112 or (T in {7317401199362650112})}]
I20260811 19:01:42.194476 9737 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5db0b47c29304706a04895484d27cef8: Sending DeleteTablet for 3 replicas of tablet 64139e935e79403484553d05d61b7166
I20260811 19:01:42.194806 10009 tablet_service.cc:1514] Processing DeleteTablet for tablet 64139e935e79403484553d05d61b7166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:42 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:43684
I20260811 19:01:42.194813 10576 tablet_service.cc:1514] Processing DeleteTablet for tablet 64139e935e79403484553d05d61b7166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:42 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:38440
I20260811 19:01:42.194880 10296 tablet_service.cc:1514] Processing DeleteTablet for tablet 64139e935e79403484553d05d61b7166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:42 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:54692
I20260811 19:01:42.195034 10815 tablet_replica.cc:330] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510: stopping tablet replica
I20260811 19:01:42.195135 10815 raft_consensus.cc:2229] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [term 1 LEADER]: Raft consensus shutting down.
I20260811 19:01:42.195179 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 9864
I20260811 19:01:42.195225 10815 raft_consensus.cc:2258] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:42.198793 10815 ts_tablet_manager.cc:1905] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:42.200343 10815 ts_tablet_manager.cc:1918] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:42.200403 10815 log.cc:1196] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/64139e935e79403484553d05d61b7166
I20260811 19:01:42.200598 10815 ts_tablet_manager.cc:1939] T 64139e935e79403484553d05d61b7166 P 7e5ac894da094684993db7fe1e354510: Deleting consensus metadata
I20260811 19:01:42.200956 9712 catalog_manager.cc:4841] TS 7e5ac894da094684993db7fe1e354510 (127.5.226.67:39795): tablet 64139e935e79403484553d05d61b7166 (table test-table [id=745e15e12bec4f7cb4cfe50dd4083346]) successfully deleted
I20260811 19:01:42.213961 10822 tablet_replica.cc:330] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646: stopping tablet replica
I20260811 19:01:42.214150 10822 raft_consensus.cc:2229] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:01:42.214304 10822 raft_consensus.cc:2258] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:42.216493 10822 ts_tablet_manager.cc:1905] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:42.218160 10822 ts_tablet_manager.cc:1918] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:42.218245 10822 log.cc:1196] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/64139e935e79403484553d05d61b7166
I20260811 19:01:42.218487 10822 ts_tablet_manager.cc:1939] T 64139e935e79403484553d05d61b7166 P 4ab80ced1fa34ff8a5323acafd24e646: Deleting consensus metadata
I20260811 19:01:42.218971 9713 catalog_manager.cc:4841] TS 4ab80ced1fa34ff8a5323acafd24e646 (127.5.226.66:36151): tablet 64139e935e79403484553d05d61b7166 (table test-table [id=745e15e12bec4f7cb4cfe50dd4083346]) successfully deleted
W20260811 19:01:42.221736 9713 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:40047 (error 108)
I20260811 19:01:42.222268 10748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.222149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:40047 (local address 127.0.0.1:43690)
0811 19:01:42.222200 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:42.222237 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:40047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 19:01:42.222427 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 10157
W20260811 19:01:42.222503 9713 catalog_manager.cc:4584] TS 3dca142f3917437391f753447280d13d (127.5.226.65:40047): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 64139e935e79403484553d05d61b7166: Network error: Client connection negotiation failed: client connection to 127.5.226.65:40047: connect: Connection refused (error 111)
I20260811 19:01:42.251871 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 10439
I20260811 19:01:42.264372 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 9687
2026-08-11T19:01:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2150 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T19:01:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:42Z Disabled control of system clock
I20260811 19:01:42.301211 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:39133
--webserver_interface=127.5.226.126
--webserver_port=0
--builtin_ntp_servers=127.5.226.84:41165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:39133
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 19:01:42.383522 10833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:42.383762 10833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:42.383792 10833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:42.384948 10833 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:42.384991 10833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:42.385008 10833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:42.385023 10833 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:42.385039 10833 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:42.386461 10833 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:41165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:39133
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:39133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:42.386729 10833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:42.387010 10833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:42.391585 10850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:42.391623 10843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:42.391613 10844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:42.391826 10833 server_base.cc:1034] running on GCE node
I20260811 19:01:42.392060 10833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:42.392359 10833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:42.393505 10833 hybrid_clock.cc:648] HybridClock initialized: now 1786474902393488 us; error 28 us; skew 500 ppm
I20260811 19:01:42.394680 10833 webserver.cc:460] Webserver started at http://127.5.226.126:41161/ using document root <none> and password file <none>
I20260811 19:01:42.394917 10833 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:42.394965 10833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:42.395098 10833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:42.396158 10833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "c48d629ecdb04d8ab56b4707243fdd97"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "fb344218275f10ee94749df2e3f02782"
server_key_iv: "07c84d69a3d7d5150c81b624c49a0392"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.396509 10833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "c48d629ecdb04d8ab56b4707243fdd97"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "fb344218275f10ee94749df2e3f02782"
server_key_iv: "07c84d69a3d7d5150c81b624c49a0392"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.397761 10833 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 19:01:42.398402 10863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:42.398551 10833 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:01:42.398638 10833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "c48d629ecdb04d8ab56b4707243fdd97"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "fb344218275f10ee94749df2e3f02782"
server_key_iv: "07c84d69a3d7d5150c81b624c49a0392"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.398698 10833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:42.409248 10833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:42.409579 10833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:42.409709 10833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:42.413486 10833 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:39133
I20260811 19:01:42.413522 10956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:39133 every 8 connection(s)
I20260811 19:01:42.413841 10833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:42.414831 10957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:42.415406 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 10833
I20260811 19:01:42.415522 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:42.415722 6025 external_mini_cluster.cc:1428] Setting key d11e68320d753ac4be5eb7d8c9da0da8
I20260811 19:01:42.418043 10957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97: Bootstrap starting.
I20260811 19:01:42.418761 10957 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:42.419081 10957 log.cc:824] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:42.419763 10957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97: No bootstrap required, opened a new log
I20260811 19:01:42.421876 10961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.416280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49200 (local address 127.5.226.126:39133)
0811 19:01:42.416565 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.416574 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.416610 (+ 36us) server_negotiation.cc:407] Connection header received
0811 19:01:42.417159 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.417169 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.417257 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.417429 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:42.417628 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.418944 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.419741 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.420363 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.420501 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.421111 (+ 610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:42.421116 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:42.421116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:42.421358 (+ 242us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:42.421401 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:42.421416 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:42.421487 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.421540 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.421630 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":125,"threads_started":1}
I20260811 19:01:42.422037 10957 raft_consensus.cc:348] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c48d629ecdb04d8ab56b4707243fdd97" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 39133 } }
I20260811 19:01:42.422168 10957 raft_consensus.cc:374] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:42.422453 10957 raft_consensus.cc:729] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c48d629ecdb04d8ab56b4707243fdd97, State: Initialized, Role: FOLLOWER
I20260811 19:01:42.422591 10957 consensus_queue.cc:260] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c48d629ecdb04d8ab56b4707243fdd97" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 39133 } }
I20260811 19:01:42.422667 10957 raft_consensus.cc:388] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:42.422698 10957 raft_consensus.cc:482] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:42.422746 10957 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:42.423254 10957 raft_consensus.cc:504] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c48d629ecdb04d8ab56b4707243fdd97" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 39133 } }
I20260811 19:01:42.423359 10957 leader_election.cc:302] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c48d629ecdb04d8ab56b4707243fdd97; no voters:
I20260811 19:01:42.423535 10957 leader_election.cc:288] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:42.423590 10967 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:42.423739 10967 raft_consensus.cc:686] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [term 1 LEADER]: Becoming Leader. State: Replica: c48d629ecdb04d8ab56b4707243fdd97, State: Running, Role: LEADER
I20260811 19:01:42.423792 10957 sys_catalog.cc:564] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:42.423827 10967 consensus_queue.cc:237] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c48d629ecdb04d8ab56b4707243fdd97" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 39133 } }
I20260811 19:01:42.424186 10972 sys_catalog.cc:455] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c48d629ecdb04d8ab56b4707243fdd97. Latest consensus state: current_term: 1 leader_uuid: "c48d629ecdb04d8ab56b4707243fdd97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c48d629ecdb04d8ab56b4707243fdd97" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 39133 } } }
I20260811 19:01:42.424268 10972 sys_catalog.cc:458] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:42.424206 10968 sys_catalog.cc:455] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c48d629ecdb04d8ab56b4707243fdd97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c48d629ecdb04d8ab56b4707243fdd97" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 39133 } } }
I20260811 19:01:42.424412 10968 sys_catalog.cc:458] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:42.424472 10983 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:42.424923 10983 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:42.426601 10983 catalog_manager.cc:1347] Generated new cluster ID: d6e8dbca40c44280b4495745a7e0dd33
I20260811 19:01:42.426658 10983 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:42.439823 10983 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:42.440557 10983 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:42.453023 10983 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97: Generated new TSK 0
I20260811 19:01:42.453218 10983 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:01:42.461283 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:39133
--builtin_ntp_servers=127.5.226.84:41165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 19:01:42.544083 11005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:42.544289 11005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:42.544317 11005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:42.545511 11005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:42.545552 11005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:42.545584 11005 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 19:01:42.546974 11005 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:41165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:39133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11005
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:42.547215 11005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:42.547513 11005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:42.553251 11014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:42.553303 11005 server_base.cc:1034] running on GCE node
W20260811 19:01:42.553257 11019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:42.553260 11013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:42.553755 11005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:42.553983 11005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:42.555121 11005 hybrid_clock.cc:648] HybridClock initialized: now 1786474902555109 us; error 26 us; skew 500 ppm
I20260811 19:01:42.556281 11005 webserver.cc:460] Webserver started at http://127.5.226.65:33641/ using document root <none> and password file <none>
I20260811 19:01:42.556553 11005 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:42.556612 11005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:42.556742 11005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:42.557860 11005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "7917e0f38d434ba38432c70649f64c06"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "7ef02e5ad6764dfed9ddb753781f7b54"
server_key_iv: "f902be87ad4d75d310e86a554126ad16"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.558185 11005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "7917e0f38d434ba38432c70649f64c06"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "7ef02e5ad6764dfed9ddb753781f7b54"
server_key_iv: "f902be87ad4d75d310e86a554126ad16"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.559370 11005 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:01:42.560029 11034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:42.560166 11005 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:42.560253 11005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "7917e0f38d434ba38432c70649f64c06"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "7ef02e5ad6764dfed9ddb753781f7b54"
server_key_iv: "f902be87ad4d75d310e86a554126ad16"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.560315 11005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:42.578627 11005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:42.578925 11005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:42.579051 11005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:42.579260 11005 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:42.579594 11005 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:42.579629 11005 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:42.579658 11005 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:42.579681 11005 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:42.585261 11005 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:34447
I20260811 19:01:42.585345 11253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:34447 every 8 connection(s)
I20260811 19:01:42.585652 11005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 19:01:42.587028 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 11005
I20260811 19:01:42.587134 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 19:01:42.587360 6025 external_mini_cluster.cc:1428] Setting key 54da0470fc5c67d4f3f79d795235517e
I20260811 19:01:42.588366 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:39133
--builtin_ntp_servers=127.5.226.84:41165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 19:01:42.591507 10961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.586386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:50417 (local address 127.5.226.126:39133)
0811 19:01:42.586451 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.586453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.586651 (+ 198us) server_negotiation.cc:407] Connection header received
0811 19:01:42.587297 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.587298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.587313 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.587372 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:42.588171 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.588779 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.590123 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.590411 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.590478 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.591247 (+ 769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:42.591249 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:42.591249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:42.591254 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:42.591271 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:42.591275 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:42.591328 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.591402 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.591433 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 19:01:42.591666 11256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.586347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:39133 (local address 127.5.226.65:50417)
0811 19:01:42.586534 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:42.586575 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:42.587147 (+ 572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:42.587464 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:42.587469 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:42.587480 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:42.588081 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.588088 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.588874 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.588875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.590038 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.590043 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.590487 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.590488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.590597 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.591109 (+ 512us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 19:01:42.591109 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:42.591139 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 19:01:42.591164 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:42.591341 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:42.591344 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:42.591347 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:01:42.591392 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 19:01:42.591472 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260811 19:01:42.592140 11254 heartbeater.cc:347] Connected to a master server at 127.5.226.126:39133
I20260811 19:01:42.592234 11254 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:42.592420 11254 heartbeater.cc:511] Master 127.5.226.126:39133 requested a full tablet report, sending...
I20260811 19:01:42.592988 10889 ts_manager.cc:194] Registered new tserver with Master: 7917e0f38d434ba38432c70649f64c06 (127.5.226.65:34447)
I20260811 19:01:42.593674 10889 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.226.65:50417
W20260811 19:01:42.671523 11257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:42.671725 11257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:42.671752 11257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:42.672879 11257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:42.672919 11257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:42.672950 11257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 19:01:42.674316 11257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:41165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:39133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:42.674546 11257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:42.674803 11257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:42.679646 11272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:42.679637 11266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:42.679733 11257 server_base.cc:1034] running on GCE node
W20260811 19:01:42.679818 11270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:42.680050 11257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:42.680250 11257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:42.681367 11257 hybrid_clock.cc:648] HybridClock initialized: now 1786474902681331 us; error 34 us; skew 500 ppm
I20260811 19:01:42.682664 11257 webserver.cc:460] Webserver started at http://127.5.226.66:45787/ using document root <none> and password file <none>
I20260811 19:01:42.682888 11257 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:42.682933 11257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:42.683055 11257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:42.684142 11257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "16b61b3a9f18413590d09bf65be8105e"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "e6220f4bbe0e321b28ebeb87c5b3d2c8"
server_key_iv: "93c11594cefe54d45a20b63b520c12e3"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.684494 11257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "16b61b3a9f18413590d09bf65be8105e"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "e6220f4bbe0e321b28ebeb87c5b3d2c8"
server_key_iv: "93c11594cefe54d45a20b63b520c12e3"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.685796 11257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 19:01:42.686465 11283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:42.686625 11257 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:01:42.686712 11257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "16b61b3a9f18413590d09bf65be8105e"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "e6220f4bbe0e321b28ebeb87c5b3d2c8"
server_key_iv: "93c11594cefe54d45a20b63b520c12e3"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.686775 11257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:42.699983 11257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:42.700264 11257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:42.700393 11257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:42.700596 11257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:42.700915 11257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:42.700948 11257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:42.700977 11257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:42.701000 11257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:42.706658 11257 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:37005
I20260811 19:01:42.706696 11497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:37005 every 8 connection(s)
I20260811 19:01:42.707010 11257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 19:01:42.711979 10961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.707688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:59223 (local address 127.5.226.126:39133)
0811 19:01:42.707740 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.707742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.707979 (+ 237us) server_negotiation.cc:407] Connection header received
0811 19:01:42.708488 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.708490 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.708502 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.708556 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:42.709226 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.709763 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.710721 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.710916 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.710972 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.711715 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:42.711716 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:42.711717 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:42.711721 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:42.711739 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:42.711743 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:42.711787 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.711864 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.711899 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 19:01:42.712165 11501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.707676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:39133 (local address 127.5.226.66:59223)
0811 19:01:42.707853 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:42.707896 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:42.708387 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:42.708626 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:42.708630 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:42.708639 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:42.709131 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.709136 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.709855 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.709856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.710631 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.710633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.710990 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.710991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.711120 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.711577 (+ 457us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 19:01:42.711578 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:42.711608 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 19:01:42.711631 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:42.711792 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:42.711798 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:42.711801 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:01:42.711872 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 19:01:42.711974 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260811 19:01:42.712606 11499 heartbeater.cc:347] Connected to a master server at 127.5.226.126:39133
I20260811 19:01:42.712688 11499 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:42.712836 11499 heartbeater.cc:511] Master 127.5.226.126:39133 requested a full tablet report, sending...
I20260811 19:01:42.713169 10889 ts_manager.cc:194] Registered new tserver with Master: 16b61b3a9f18413590d09bf65be8105e (127.5.226.66:37005)
I20260811 19:01:42.713557 10889 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.226.66:59223
I20260811 19:01:42.714674 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 11257
I20260811 19:01:42.714762 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 19:01:42.714928 6025 external_mini_cluster.cc:1428] Setting key cc0825619424183102c1c1adef99f8e2
I20260811 19:01:42.715750 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:39133
--builtin_ntp_servers=127.5.226.84:41165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 19:01:42.797761 11502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:42.797967 11502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:42.797997 11502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:42.799119 11502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:42.799156 11502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:42.799188 11502 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 19:01:42.800501 11502 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:41165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:39133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:42.800729 11502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:42.801005 11502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:42.805766 11511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:42.805763 11509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:42.805766 11508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:42.805881 11502 server_base.cc:1034] running on GCE node
I20260811 19:01:42.806149 11502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:42.806349 11502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:42.807497 11502 hybrid_clock.cc:648] HybridClock initialized: now 1786474902807488 us; error 26 us; skew 500 ppm
I20260811 19:01:42.808609 11502 webserver.cc:460] Webserver started at http://127.5.226.67:41453/ using document root <none> and password file <none>
I20260811 19:01:42.808830 11502 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:42.808877 11502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:42.809001 11502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:42.810060 11502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "c63eba82fa6b409fa7bbd58e3170d08e"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "dfef9a4b7a965434fc12a788aaa565d0"
server_key_iv: "5051a95b66f390882d3ab850e0966e99"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.810396 11502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "c63eba82fa6b409fa7bbd58e3170d08e"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "dfef9a4b7a965434fc12a788aaa565d0"
server_key_iv: "5051a95b66f390882d3ab850e0966e99"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.811579 11502 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:01:42.812197 11526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:42.812327 11502 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:42.812412 11502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "c63eba82fa6b409fa7bbd58e3170d08e"
format_stamp: "Formatted at 2026-08-11 19:01:42 on dist-test-slave-gjw7"
server_key: "dfef9a4b7a965434fc12a788aaa565d0"
server_key_iv: "5051a95b66f390882d3ab850e0966e99"
server_key_version: "encryptionkey@0"
I20260811 19:01:42.812471 11502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:42.829558 11502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:42.829878 11502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:42.830013 11502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:42.830243 11502 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:42.830578 11502 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:42.830612 11502 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:42.830643 11502 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:42.830667 11502 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:42.836119 11502 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:44245
I20260811 19:01:42.836220 11745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:44245 every 8 connection(s)
I20260811 19:01:42.836495 11502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 19:01:42.841027 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 11502
I20260811 19:01:42.841136 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 19:01:42.841377 6025 external_mini_cluster.cc:1428] Setting key f5c5b06150bc7e1ed6388da2808f4ffa
I20260811 19:01:42.841686 10961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.837177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:41159 (local address 127.5.226.126:39133)
0811 19:01:42.837224 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.837225 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.837502 (+ 277us) server_negotiation.cc:407] Connection header received
0811 19:01:42.838044 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.838045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.838058 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.838112 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:42.838794 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.839276 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.840245 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.840442 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.840498 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.841375 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:42.841377 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:42.841377 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:42.841382 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:42.841398 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:42.841401 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:42.841450 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.841573 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.841600 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 19:01:42.841920 11754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.837161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:39133 (local address 127.5.226.67:41159)
0811 19:01:42.837387 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:42.837423 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:42.837940 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:42.838194 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:42.838198 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:42.838209 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:42.838706 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.838711 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.839360 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.839361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.840160 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.840162 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.840513 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.840514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.840647 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.841201 (+ 554us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 19:01:42.841202 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:42.841234 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 19:01:42.841258 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:42.841474 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:42.841483 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:42.841487 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:01:42.841566 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 19:01:42.841672 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":90,"threads_started":1}
I20260811 19:01:42.842344 11747 heartbeater.cc:347] Connected to a master server at 127.5.226.126:39133
I20260811 19:01:42.842437 11747 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:42.842618 11747 heartbeater.cc:511] Master 127.5.226.126:39133 requested a full tablet report, sending...
I20260811 19:01:42.842962 10888 ts_manager.cc:194] Registered new tserver with Master: c63eba82fa6b409fa7bbd58e3170d08e (127.5.226.67:44245)
I20260811 19:01:42.843319 10888 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.226.67:41159
I20260811 19:01:42.853152 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 19:01:42.856891 10961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.854448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49214 (local address 127.5.226.126:39133)
0811 19:01:42.854494 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.854496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.854582 (+ 86us) server_negotiation.cc:407] Connection header received
0811 19:01:42.854632 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.854633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.854640 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.854675 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:42.854813 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.855250 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.855939 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.856108 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.856146 (+ 38us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.856721 (+ 575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:42.856721 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:42.856722 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:42.856725 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:42.856734 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:42.856737 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:42.856785 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.856829 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.856837 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 19:01:42.858481 10888 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49214:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 19:01:42.859972 10888 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 19:01:42.866262 11773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.862352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53906 (local address 127.5.226.67:44245)
0811 19:01:42.862734 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.862738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.862747 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:01:42.862780 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.862782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.862797 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.863013 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:42.863064 (+ 51us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.864108 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.865178 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.865902 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.865973 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.866063 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.866148 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.866186 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":69,"threads_started":1}
I20260811 19:01:42.866256 11763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.861999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:44245 (local address 127.0.0.1:53906)
0811 19:01:42.862108 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:42.862148 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:42.862209 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:42.862889 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:42.862890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:42.862896 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:42.862943 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.862945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.864223 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.864224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.865104 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.865107 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.865984 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.865985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.866051 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.866062 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 19:01:42.866121 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 19:01:42.866172 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":59,"threads_started":1}
I20260811 19:01:42.866321 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.862521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41246 (local address 127.5.226.66:37005)
0811 19:01:42.862706 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.862711 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.862720 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:01:42.862766 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.862768 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.862782 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.863001 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:42.863057 (+ 56us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.863895 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.865326 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.866028 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.866094 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.866172 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.866204 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.866245 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":85,"threads_started":1}
I20260811 19:01:42.866310 11767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.862001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:37005 (local address 127.0.0.1:41246)
0811 19:01:42.862138 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:42.862148 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:42.862207 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:42.862889 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:42.862890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:42.862892 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:42.862928 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.862929 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.863967 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.863968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.865230 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.865233 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.866099 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.866100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.866151 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.866154 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:01:42.866185 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 19:01:42.866216 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
I20260811 19:01:42.867344 11771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.862207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:34447 (local address 127.0.0.1:36232)
0811 19:01:42.862324 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:42.862332 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:42.862383 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:42.862708 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:42.862711 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:42.862713 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:42.862779 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.862781 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.864160 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.864161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.865241 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:42.865243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.867112 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.867113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:42.867174 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.867179 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 19:01:42.867220 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 19:01:42.867261 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":29,"thread_start_us":72,"threads_started":1}
I20260811 19:01:42.867344 11772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:42.862325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36232 (local address 127.5.226.65:34447)
0811 19:01:42.862516 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:42.862521 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:42.862533 (+ 12us) server_negotiation.cc:407] Connection header received
0811 19:01:42.862574 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:42.862577 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:42.862592 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:42.862670 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:42.862936 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.864066 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.866434 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:42.867038 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:42.867098 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:42.867178 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:42.867232 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 19:01:42.867266 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":87,"threads_started":1}
I20260811 19:01:42.867445 11372 tablet_service.cc:1467] Processing CreateTablet for tablet f9ff1aafb199487eb6e0b4ebbd55959a (DEFAULT_TABLE table=test-table [id=9d57bb9e816241c0bb360faf6e7399cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:42.867449 11627 tablet_service.cc:1467] Processing CreateTablet for tablet f9ff1aafb199487eb6e0b4ebbd55959a (DEFAULT_TABLE table=test-table [id=9d57bb9e816241c0bb360faf6e7399cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:42.867807 11372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9ff1aafb199487eb6e0b4ebbd55959a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:42.867807 11627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9ff1aafb199487eb6e0b4ebbd55959a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:42.869653 11129 tablet_service.cc:1467] Processing CreateTablet for tablet f9ff1aafb199487eb6e0b4ebbd55959a (DEFAULT_TABLE table=test-table [id=9d57bb9e816241c0bb360faf6e7399cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:42.869922 11129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9ff1aafb199487eb6e0b4ebbd55959a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:42.871233 11776 tablet_bootstrap.cc:492] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e: Bootstrap starting.
I20260811 19:01:42.871919 11776 tablet_bootstrap.cc:654] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:42.872256 11776 log.cc:824] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:42.872635 11775 tablet_bootstrap.cc:492] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e: Bootstrap starting.
I20260811 19:01:42.872779 11782 tablet_bootstrap.cc:492] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06: Bootstrap starting.
I20260811 19:01:42.873174 11776 tablet_bootstrap.cc:492] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e: No bootstrap required, opened a new log
I20260811 19:01:42.873310 11776 ts_tablet_manager.cc:1397] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:01:42.873329 11775 tablet_bootstrap.cc:654] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:42.873461 11782 tablet_bootstrap.cc:654] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:42.873616 11775 log.cc:824] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:42.873790 11782 log.cc:824] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:42.874411 11775 tablet_bootstrap.cc:492] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e: No bootstrap required, opened a new log
I20260811 19:01:42.874481 11775 ts_tablet_manager.cc:1397] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 19:01:42.874482 11782 tablet_bootstrap.cc:492] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06: No bootstrap required, opened a new log
I20260811 19:01:42.874542 11782 ts_tablet_manager.cc:1397] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 19:01:42.875949 11776 raft_consensus.cc:348] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63eba82fa6b409fa7bbd58e3170d08e" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44245 } } peers { permanent_uuid: "16b61b3a9f18413590d09bf65be8105e" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37005 } } peers { permanent_uuid: "7917e0f38d434ba38432c70649f64c06" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34447 } }
I20260811 19:01:42.876130 11776 raft_consensus.cc:374] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:42.876164 11776 raft_consensus.cc:729] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16b61b3a9f18413590d09bf65be8105e, State: Initialized, Role: FOLLOWER
I20260811 19:01:42.876308 11776 consensus_queue.cc:260] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63eba82fa6b409fa7bbd58e3170d08e" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44245 } } peers { permanent_uuid: "16b61b3a9f18413590d09bf65be8105e" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37005 } } peers { permanent_uuid: "7917e0f38d434ba38432c70649f64c06" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34447 } }
I20260811 19:01:42.876573 11776 ts_tablet_manager.cc:1428] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 19:01:42.876729 11499 heartbeater.cc:503] Master 127.5.226.126:39133 was elected leader, sending a full tablet report...
I20260811 19:01:42.876778 11782 raft_consensus.cc:348] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63eba82fa6b409fa7bbd58e3170d08e" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44245 } } peers { permanent_uuid: "16b61b3a9f18413590d09bf65be8105e" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37005 } } peers { permanent_uuid: "7917e0f38d434ba38432c70649f64c06" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34447 } }
I20260811 19:01:42.876933 11782 raft_consensus.cc:374] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:42.876976 11782 raft_consensus.cc:729] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7917e0f38d434ba38432c70649f64c06, State: Initialized, Role: FOLLOWER
I20260811 19:01:42.876920 11775 raft_consensus.cc:348] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63eba82fa6b409fa7bbd58e3170d08e" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44245 } } peers { permanent_uuid: "16b61b3a9f18413590d09bf65be8105e" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37005 } } peers { permanent_uuid: "7917e0f38d434ba38432c70649f64c06" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34447 } }
I20260811 19:01:42.877063 11775 raft_consensus.cc:374] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:42.877101 11775 raft_consensus.cc:729] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c63eba82fa6b409fa7bbd58e3170d08e, State: Initialized, Role: FOLLOWER
I20260811 19:01:42.877076 11782 consensus_queue.cc:260] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63eba82fa6b409fa7bbd58e3170d08e" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44245 } } peers { permanent_uuid: "16b61b3a9f18413590d09bf65be8105e" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37005 } } peers { permanent_uuid: "7917e0f38d434ba38432c70649f64c06" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34447 } }
I20260811 19:01:42.877238 11775 consensus_queue.cc:260] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63eba82fa6b409fa7bbd58e3170d08e" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44245 } } peers { permanent_uuid: "16b61b3a9f18413590d09bf65be8105e" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37005 } } peers { permanent_uuid: "7917e0f38d434ba38432c70649f64c06" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34447 } }
I20260811 19:01:42.877363 11782 ts_tablet_manager.cc:1428] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 19:01:42.877481 11254 heartbeater.cc:503] Master 127.5.226.126:39133 was elected leader, sending a full tablet report...
I20260811 19:01:42.877528 11775 ts_tablet_manager.cc:1428] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 19:01:42.877561 11747 heartbeater.cc:503] Master 127.5.226.126:39133 was elected leader, sending a full tablet report...
W20260811 19:01:42.957552 11500 tablet.cc:2369] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:01:43.037595 11792 raft_consensus.cc:482] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:01:43.037735 11792 raft_consensus.cc:504] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63eba82fa6b409fa7bbd58e3170d08e" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44245 } } peers { permanent_uuid: "16b61b3a9f18413590d09bf65be8105e" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37005 } } peers { permanent_uuid: "7917e0f38d434ba38432c70649f64c06" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34447 } }
I20260811 19:01:43.038134 11792 leader_election.cc:288] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c63eba82fa6b409fa7bbd58e3170d08e (127.5.226.67:44245), 16b61b3a9f18413590d09bf65be8105e (127.5.226.66:37005)
I20260811 19:01:43.041978 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:43.038458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:47797 (local address 127.5.226.66:37005)
0811 19:01:43.038499 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:43.038501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:43.038649 (+ 148us) server_negotiation.cc:407] Connection header received
0811 19:01:43.038681 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:43.038682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:43.038689 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:43.038733 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:43.038865 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:43.039554 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:43.041010 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:43.041597 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:43.041669 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:43.041676 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:43.041861 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 19:01:43.041904 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 19:01:43.041978 11773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:43.038402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:35289 (local address 127.5.226.67:44245)
0811 19:01:43.038471 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:43.038473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:43.038484 (+ 11us) server_negotiation.cc:407] Connection header received
0811 19:01:43.038520 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:43.038521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:43.038532 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:43.038593 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:43.038786 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:43.039542 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:43.041009 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:43.041597 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:43.041667 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:43.041676 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:43.041874 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 19:01:43.041910 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 19:01:43.041988 11256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:43.038328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:44245 (local address 127.5.226.65:35289)
0811 19:01:43.038402 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:43.038414 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:43.038458 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:43.038625 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:43.038626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:43.038628 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:43.038712 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:43.038714 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:43.039621 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:43.039622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:43.040920 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:43.040923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:43.041677 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:43.041678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:43.041789 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:43.041795 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 19:01:43.041857 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 19:01:43.041890 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":54}
I20260811 19:01:43.041993 11797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:43.038353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:37005 (local address 127.5.226.65:47797)
0811 19:01:43.038576 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:43.038585 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:43.038639 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:43.038750 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:43.038751 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:43.038752 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:43.038810 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:43.038811 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:43.039620 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:43.039621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:43.040920 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:43.040923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:43.041677 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:43.041678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:43.041789 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:43.041795 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 19:01:43.041847 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 19:01:43.041887 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":121,"thread_start_us":120,"threads_started":1}
I20260811 19:01:43.042368 11667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9ff1aafb199487eb6e0b4ebbd55959a" candidate_uuid: "7917e0f38d434ba38432c70649f64c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c63eba82fa6b409fa7bbd58e3170d08e" is_pre_election: true
I20260811 19:01:43.042526 11667 raft_consensus.cc:2454] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7917e0f38d434ba38432c70649f64c06 in term 0.
I20260811 19:01:43.042662 11420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9ff1aafb199487eb6e0b4ebbd55959a" candidate_uuid: "7917e0f38d434ba38432c70649f64c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16b61b3a9f18413590d09bf65be8105e" is_pre_election: true
I20260811 19:01:43.042785 11040 leader_election.cc:302] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7917e0f38d434ba38432c70649f64c06, c63eba82fa6b409fa7bbd58e3170d08e; no voters:
I20260811 19:01:43.042826 11420 raft_consensus.cc:2454] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7917e0f38d434ba38432c70649f64c06 in term 0.
I20260811 19:01:43.042924 11792 raft_consensus.cc:2781] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 19:01:43.043009 11792 raft_consensus.cc:482] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 19:01:43.043037 11792 raft_consensus.cc:3037] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:43.043752 11792 raft_consensus.cc:504] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63eba82fa6b409fa7bbd58e3170d08e" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44245 } } peers { permanent_uuid: "16b61b3a9f18413590d09bf65be8105e" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37005 } } peers { permanent_uuid: "7917e0f38d434ba38432c70649f64c06" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34447 } }
I20260811 19:01:43.043871 11792 leader_election.cc:288] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [CANDIDATE]: Term 1 election: Requested vote from peers c63eba82fa6b409fa7bbd58e3170d08e (127.5.226.67:44245), 16b61b3a9f18413590d09bf65be8105e (127.5.226.66:37005)
I20260811 19:01:43.044018 11420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9ff1aafb199487eb6e0b4ebbd55959a" candidate_uuid: "7917e0f38d434ba38432c70649f64c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16b61b3a9f18413590d09bf65be8105e"
I20260811 19:01:43.044036 11667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9ff1aafb199487eb6e0b4ebbd55959a" candidate_uuid: "7917e0f38d434ba38432c70649f64c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c63eba82fa6b409fa7bbd58e3170d08e"
I20260811 19:01:43.044106 11667 raft_consensus.cc:3037] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:43.044096 11420 raft_consensus.cc:3037] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:43.044991 11420 raft_consensus.cc:2454] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7917e0f38d434ba38432c70649f64c06 in term 1.
I20260811 19:01:43.044991 11667 raft_consensus.cc:2454] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7917e0f38d434ba38432c70649f64c06 in term 1.
I20260811 19:01:43.045156 11040 leader_election.cc:302] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7917e0f38d434ba38432c70649f64c06, c63eba82fa6b409fa7bbd58e3170d08e; no voters:
I20260811 19:01:43.045249 11792 raft_consensus.cc:2781] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:43.045423 11792 raft_consensus.cc:686] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [term 1 LEADER]: Becoming Leader. State: Replica: 7917e0f38d434ba38432c70649f64c06, State: Running, Role: LEADER
I20260811 19:01:43.045519 11792 consensus_queue.cc:237] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63eba82fa6b409fa7bbd58e3170d08e" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44245 } } peers { permanent_uuid: "16b61b3a9f18413590d09bf65be8105e" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37005 } } peers { permanent_uuid: "7917e0f38d434ba38432c70649f64c06" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34447 } }
I20260811 19:01:43.046365 10887 catalog_manager.cc:5495] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7917e0f38d434ba38432c70649f64c06 (127.5.226.65). New cstate: current_term: 1 leader_uuid: "7917e0f38d434ba38432c70649f64c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63eba82fa6b409fa7bbd58e3170d08e" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16b61b3a9f18413590d09bf65be8105e" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7917e0f38d434ba38432c70649f64c06" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 34447 } health_report { overall_health: HEALTHY } } }
I20260811 19:01:43.051388 11772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:43.049179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36242 (local address 127.5.226.65:34447)
0811 19:01:43.049222 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:43.049225 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:43.049233 (+ 8us) server_negotiation.cc:407] Connection header received
0811 19:01:43.049318 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:43.049319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:43.049348 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:43.049407 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:01:43.049535 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:43.049974 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:43.050684 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:43.050865 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:43.050918 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:43.051069 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:01:43.051155 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:01:43.051236 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:43.051290 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 19:01:43.051300 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 19:01:43.052978 11420 raft_consensus.cc:1261] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e [term 1 FOLLOWER]: Refusing update from remote peer 7917e0f38d434ba38432c70649f64c06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:01:43.052999 11667 raft_consensus.cc:1261] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e [term 1 FOLLOWER]: Refusing update from remote peer 7917e0f38d434ba38432c70649f64c06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:01:43.053284 11792 consensus_queue.cc:1035] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c63eba82fa6b409fa7bbd58e3170d08e" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 44245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:01:43.053450 11798 consensus_queue.cc:1035] T f9ff1aafb199487eb6e0b4ebbd55959a P 7917e0f38d434ba38432c70649f64c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16b61b3a9f18413590d09bf65be8105e" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:01:43.055784 11810 mvcc.cc:205] Tried to move back new op lower bound from 7317401202902609920 to 7317401202875023360. Current Snapshot: MvccSnapshot[applied={T|T < 7317401202902609920}]
I20260811 19:01:43.056979 11805 mvcc.cc:205] Tried to move back new op lower bound from 7317401202902609920 to 7317401202875023360. Current Snapshot: MvccSnapshot[applied={T|T < 7317401202902609920 or (T in {7317401202902609920})}]
I20260811 19:01:43.058044 10887 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:01:43.058122 10887 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:01:43.058756 10887 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c48d629ecdb04d8ab56b4707243fdd97: Sending DeleteTablet for 3 replicas of tablet f9ff1aafb199487eb6e0b4ebbd55959a
I20260811 19:01:43.059073 11129 tablet_service.cc:1514] Processing DeleteTablet for tablet f9ff1aafb199487eb6e0b4ebbd55959a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:43 UTC) from {username='slave'} at 127.0.0.1:36232
I20260811 19:01:43.059088 11627 tablet_service.cc:1514] Processing DeleteTablet for tablet f9ff1aafb199487eb6e0b4ebbd55959a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:43 UTC) from {username='slave'} at 127.0.0.1:53906
I20260811 19:01:43.059090 11372 tablet_service.cc:1514] Processing DeleteTablet for tablet f9ff1aafb199487eb6e0b4ebbd55959a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:43 UTC) from {username='slave'} at 127.0.0.1:41246
I20260811 19:01:43.059296 11831 tablet_replica.cc:330] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e: stopping tablet replica
I20260811 19:01:43.059415 11831 raft_consensus.cc:2229] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:01:43.059516 11831 raft_consensus.cc:2258] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:43.059587 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 11005
I20260811 19:01:43.071131 11829 tablet_replica.cc:330] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e: stopping tablet replica
I20260811 19:01:43.071332 11829 raft_consensus.cc:2229] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:01:43.071471 11829 raft_consensus.cc:2258] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:43.072366 11831 ts_tablet_manager.cc:1905] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:43.072352 11829 ts_tablet_manager.cc:1905] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:43.074100 11831 ts_tablet_manager.cc:1918] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:43.074100 11829 ts_tablet_manager.cc:1918] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:43.074182 11831 log.cc:1196] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/f9ff1aafb199487eb6e0b4ebbd55959a
I20260811 19:01:43.074184 11829 log.cc:1196] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/f9ff1aafb199487eb6e0b4ebbd55959a
I20260811 19:01:43.074458 11831 ts_tablet_manager.cc:1939] T f9ff1aafb199487eb6e0b4ebbd55959a P c63eba82fa6b409fa7bbd58e3170d08e: Deleting consensus metadata
I20260811 19:01:43.074457 11829 ts_tablet_manager.cc:1939] T f9ff1aafb199487eb6e0b4ebbd55959a P 16b61b3a9f18413590d09bf65be8105e: Deleting consensus metadata
I20260811 19:01:43.074892 10868 catalog_manager.cc:4841] TS 16b61b3a9f18413590d09bf65be8105e (127.5.226.66:37005): tablet f9ff1aafb199487eb6e0b4ebbd55959a (table test-table [id=9d57bb9e816241c0bb360faf6e7399cc]) successfully deleted
I20260811 19:01:43.074892 10866 catalog_manager.cc:4841] TS c63eba82fa6b409fa7bbd58e3170d08e (127.5.226.67:44245): tablet f9ff1aafb199487eb6e0b4ebbd55959a (table test-table [id=9d57bb9e816241c0bb360faf6e7399cc]) successfully deleted
W20260811 19:01:43.076278 10866 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:34447 (error 108)
I20260811 19:01:43.076745 11771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:43.076615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:34447 (local address 127.0.0.1:36258)
0811 19:01:43.076667 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:43.076711 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:34447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 19:01:43.076815 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 11257
W20260811 19:01:43.076896 10866 catalog_manager.cc:4584] TS 7917e0f38d434ba38432c70649f64c06 (127.5.226.65:34447): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f9ff1aafb199487eb6e0b4ebbd55959a: Network error: Client connection negotiation failed: client connection to 127.5.226.65:34447: connect: Connection refused (error 111)
I20260811 19:01:43.093248 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 11502
I20260811 19:01:43.132007 11771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:43.130842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:34447 (local address 127.0.0.1:36268)
0811 19:01:43.131896 (+ 1054us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:43.131956 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:34447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1013}
I20260811 19:01:43.132632 11771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:43.132514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:34447 (local address 127.0.0.1:36282)
0811 19:01:43.132568 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:43.132603 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:34447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 19:01:43.136286 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 10833
2026-08-11T19:01:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (873 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:01:43 dist-test-slave-gjw7 krb5kdc[11837](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:01:43 dist-test-slave-gjw7 krb5kdc[11837](info): set up 2 sockets
Aug 11 19:01:43 dist-test-slave-gjw7 krb5kdc[11837](info): commencing operation
krb5kdc: starting...
W20260811 19:01:44.370471 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:01:44 dist-test-slave-gjw7 krb5kdc[11837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:01:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:01:44.489044 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:40073
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:40073
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:44.570899 11854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:44.571094 11854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:44.571115 11854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:44.572206 11854 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:44.572239 11854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:44.572252 11854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:44.572263 11854 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:44.572278 11854 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:44.573746 11854 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:40073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:40073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:44.573958 11854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:44.574141 11854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:44.578966 11868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:44.578994 11866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:44.579103 11854 server_base.cc:1034] running on GCE node
W20260811 19:01:44.578994 11871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:44.579453 11854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:44.579738 11854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:44.580881 11854 hybrid_clock.cc:648] HybridClock initialized: now 1786474904580868 us; error 29 us; skew 500 ppm
Aug 11 19:01:44 dist-test-slave-gjw7 krb5kdc[11837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474904, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:44.587114 11854 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:01:44.587579 11854 webserver.cc:460] Webserver started at http://127.5.226.126:39649/ using document root <none> and password file <none>
I20260811 19:01:44.587813 11854 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:44.587867 11854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:44.588001 11854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:44.589107 11854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "3bbd455d1b8b42538a0586be17fa3c8b"
format_stamp: "Formatted at 2026-08-11 19:01:44 on dist-test-slave-gjw7"
server_key: "493856fb7f3667ec12ca6fbd71f2fe40"
server_key_iv: "37190c170b04413c3cbf2fdbe0e8034f"
server_key_version: "encryptionkey@0"
I20260811 19:01:44.589491 11854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "3bbd455d1b8b42538a0586be17fa3c8b"
format_stamp: "Formatted at 2026-08-11 19:01:44 on dist-test-slave-gjw7"
server_key: "493856fb7f3667ec12ca6fbd71f2fe40"
server_key_iv: "37190c170b04413c3cbf2fdbe0e8034f"
server_key_version: "encryptionkey@0"
I20260811 19:01:44.590909 11854 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 19:01:44.591593 11883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:44.591743 11854 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:01:44.591835 11854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "3bbd455d1b8b42538a0586be17fa3c8b"
format_stamp: "Formatted at 2026-08-11 19:01:44 on dist-test-slave-gjw7"
server_key: "493856fb7f3667ec12ca6fbd71f2fe40"
server_key_iv: "37190c170b04413c3cbf2fdbe0e8034f"
server_key_version: "encryptionkey@0"
I20260811 19:01:44.591902 11854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:44.626561 11854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:44.628542 11854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:44.628691 11854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:44.632615 11854 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:40073
I20260811 19:01:44.632656 12000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:40073 every 8 connection(s)
I20260811 19:01:44.632988 11854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:44.633912 12004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:44.634609 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 11854
I20260811 19:01:44.634732 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:44.634964 6025 external_mini_cluster.cc:1428] Setting key 63127cd1551c4dc638e045975bd8d46a
I20260811 19:01:44.637008 12004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b: Bootstrap starting.
I20260811 19:01:44.637645 12004 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:44.637933 12004 log.cc:824] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:44.638581 12004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b: No bootstrap required, opened a new log
I20260811 19:01:44.640525 12004 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bbd455d1b8b42538a0586be17fa3c8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40073 } }
I20260811 19:01:44.640667 12004 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:44.640689 12004 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bbd455d1b8b42538a0586be17fa3c8b, State: Initialized, Role: FOLLOWER
I20260811 19:01:44.640825 12004 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bbd455d1b8b42538a0586be17fa3c8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40073 } }
I20260811 19:01:44.640906 12004 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:44.640938 12004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:44.640987 12004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [term 0 FOLLOWER]: Advancing to term 1
Aug 11 19:01:44 dist-test-slave-gjw7 krb5kdc[11837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:01:44.641570 12004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bbd455d1b8b42538a0586be17fa3c8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40073 } }
I20260811 19:01:44.641675 12004 leader_election.cc:302] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3bbd455d1b8b42538a0586be17fa3c8b; no voters:
I20260811 19:01:44.641871 12004 leader_election.cc:288] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:44.641916 12013 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:44.642107 12013 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [term 1 LEADER]: Becoming Leader. State: Replica: 3bbd455d1b8b42538a0586be17fa3c8b, State: Running, Role: LEADER
I20260811 19:01:44.642146 12004 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:44.642204 12013 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bbd455d1b8b42538a0586be17fa3c8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40073 } }
I20260811 19:01:44.642556 12013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3bbd455d1b8b42538a0586be17fa3c8b. Latest consensus state: current_term: 1 leader_uuid: "3bbd455d1b8b42538a0586be17fa3c8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bbd455d1b8b42538a0586be17fa3c8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40073 } } }
I20260811 19:01:44.642637 12013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:44.642736 12020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3bbd455d1b8b42538a0586be17fa3c8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bbd455d1b8b42538a0586be17fa3c8b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40073 } } }
I20260811 19:01:44.642808 12020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b [sys.catalog]: This master's current role is: LEADER
W20260811 19:01:44.644119 12043 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:01:44.644177 12043 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:01:44.644229 12028 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:44.644445 12028 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:44.645663 12009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:44.635499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44428 (local address 127.5.226.126:40073)
0811 19:01:44.635655 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:44.635662 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:44.635689 (+ 27us) server_negotiation.cc:407] Connection header received
0811 19:01:44.636130 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:44.636138 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:44.636215 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:44.636327 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:44.637145 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:44.638142 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:44.638930 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:44.639344 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:44.639449 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:44.641753 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:44.641758 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:44.641758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:44.641771 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:44.643823 (+ 2052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:44.644223 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:44.644226 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:44.644226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:44.644364 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:44.644611 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:44.644612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:44.644613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:44.644929 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:44.645104 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:44.645359 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 19:01:44.645510 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260811 19:01:44.646153 12028 catalog_manager.cc:1347] Generated new cluster ID: 6e85a1739ffc43a7b9ff3cdbda105c0d
I20260811 19:01:44.646206 12028 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:44.659339 12028 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:44.660076 12028 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:44.669176 12028 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b: Generated new TSK 0
I20260811 19:01:44.669405 12028 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.226.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
Entry for principal kudu/127.5.226.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab.
I20260811 19:01:44.702349 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40073
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:44.784826 12060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:44.785038 12060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:44.785061 12060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:44.786224 12060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:44.786273 12060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:44.786301 12060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 19:01:44.787863 12060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.65.keytab
--principal=kudu/127.5.226.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:44.788106 12060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:44.788319 12060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:44.793128 12069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:44.793154 12077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:44.793133 12070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:44.793417 12060 server_base.cc:1034] running on GCE node
I20260811 19:01:44.793622 12060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:44.793834 12060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:44.794971 12060 hybrid_clock.cc:648] HybridClock initialized: now 1786474904794959 us; error 30 us; skew 500 ppm
Aug 11 19:01:44 dist-test-slave-gjw7 krb5kdc[11837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474904, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:44.797441 12060 init.cc:377] Logged in from keytab as kudu/127.5.226.65@KRBTEST.COM (short username kudu)
I20260811 19:01:44.797857 12060 webserver.cc:460] Webserver started at http://127.5.226.65:46273/ using document root <none> and password file <none>
I20260811 19:01:44.798076 12060 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:44.798120 12060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:44.798250 12060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:44.799278 12060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "bebdf677f68b4ecb916c35c9fc0f19b0"
format_stamp: "Formatted at 2026-08-11 19:01:44 on dist-test-slave-gjw7"
server_key: "b312ddec6fb6b7529a44685644c4dc58"
server_key_iv: "1c6822fe67b012ae4252f3fc976b096b"
server_key_version: "encryptionkey@0"
I20260811 19:01:44.799621 12060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "bebdf677f68b4ecb916c35c9fc0f19b0"
format_stamp: "Formatted at 2026-08-11 19:01:44 on dist-test-slave-gjw7"
server_key: "b312ddec6fb6b7529a44685644c4dc58"
server_key_iv: "1c6822fe67b012ae4252f3fc976b096b"
server_key_version: "encryptionkey@0"
I20260811 19:01:44.800833 12060 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 19:01:44.801520 12092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:44.801662 12060 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:44.801745 12060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "bebdf677f68b4ecb916c35c9fc0f19b0"
format_stamp: "Formatted at 2026-08-11 19:01:44 on dist-test-slave-gjw7"
server_key: "b312ddec6fb6b7529a44685644c4dc58"
server_key_iv: "1c6822fe67b012ae4252f3fc976b096b"
server_key_version: "encryptionkey@0"
I20260811 19:01:44.801815 12060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:44.808719 12060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:44.810397 12060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:44.810520 12060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:44.810709 12060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:44.810997 12060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:44.811031 12060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:44.811053 12060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:44.811075 12060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:44.816658 12060 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:42311
I20260811 19:01:44.816715 12310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:42311 every 8 connection(s)
I20260811 19:01:44.817016 12060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 19:01:44.817684 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 12060
I20260811 19:01:44.817802 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 19:01:44.818050 6025 external_mini_cluster.cc:1428] Setting key 9938f7c6459c9d78b06e427c6eeef672
Aug 11 19:01:44 dist-test-slave-gjw7 krb5kdc[11837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474904, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.65@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:01:44.826900 12009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:44.817755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:34739 (local address 127.5.226.126:40073)
0811 19:01:44.818251 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:44.818254 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:44.818268 (+ 14us) server_negotiation.cc:407] Connection header received
0811 19:01:44.818621 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:44.818623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:44.818635 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:44.818693 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:44.819661 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:44.820179 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:44.821231 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:44.821570 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:44.821636 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:44.824173 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:44.824174 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:44.824175 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:44.824182 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:44.825514 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:44.825985 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:44.825985 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:44.825986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:44.826035 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:44.826289 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:44.826289 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:44.826290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:44.826392 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:44.826437 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:44.826759 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 19:01:44.826830 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467}
WARNING: no policy specified for kudu/127.5.226.66@KRBTEST.COM; defaulting to no policy
I20260811 19:01:44.827178 12317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:44.817688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40073 (local address 127.5.226.65:34739)
0811 19:01:44.817864 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:44.817915 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:44.818524 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:44.818767 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:44.818771 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:44.819358 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:44.819564 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:44.819569 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:44.820287 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:44.820289 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:44.821146 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:44.821148 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:44.821658 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:44.821659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:44.821795 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:44.822306 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:44.822315 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:44.824072 (+ 1757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:44.825590 (+ 1518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:44.825598 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:44.825601 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:44.825916 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:44.826089 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:44.826090 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:44.826091 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:44.826233 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:44.826451 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:44.826458 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:44.826629 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 19:01:44.826750 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 19:01:44.826933 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":81,"threads_started":1}
I20260811 19:01:44.827723 12313 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40073
I20260811 19:01:44.827814 12313 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:44.827998 12313 heartbeater.cc:511] Master 127.5.226.126:40073 requested a full tablet report, sending...
I20260811 19:01:44.828524 11916 ts_manager.cc:194] Registered new tserver with Master: bebdf677f68b4ecb916c35c9fc0f19b0 (127.5.226.65:42311)
I20260811 19:01:44.829195 11916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.65@KRBTEST.COM'} at 127.5.226.65:34739
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
Entry for principal kudu/127.5.226.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab.
I20260811 19:01:44.844148 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40073
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:44.926045 12322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:44.926257 12322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:44.926287 12322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:44.927412 12322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:44.927454 12322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:44.927486 12322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 19:01:44.928926 12322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.66.keytab
--principal=kudu/127.5.226.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:44.929165 12322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:44.929409 12322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 19:01:44.934144 12322 server_base.cc:1034] running on GCE node
W20260811 19:01:44.934109 12335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:44.934082 12342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:44.934078 12338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:44.934504 12322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:44.934738 12322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:44.935873 12322 hybrid_clock.cc:648] HybridClock initialized: now 1786474904935858 us; error 30 us; skew 500 ppm
Aug 11 19:01:44 dist-test-slave-gjw7 krb5kdc[11837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474904, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:44.938237 12322 init.cc:377] Logged in from keytab as kudu/127.5.226.66@KRBTEST.COM (short username kudu)
I20260811 19:01:44.938638 12322 webserver.cc:460] Webserver started at http://127.5.226.66:32999/ using document root <none> and password file <none>
I20260811 19:01:44.938833 12322 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:44.938879 12322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:44.939005 12322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:44.940018 12322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "1e71aab9e2494b28864d5de75379beec"
format_stamp: "Formatted at 2026-08-11 19:01:44 on dist-test-slave-gjw7"
server_key: "db5037255df78caf436c33caa069db51"
server_key_iv: "d1fb227fde7cf53b4b832e972ef62f8f"
server_key_version: "encryptionkey@0"
I20260811 19:01:44.940373 12322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "1e71aab9e2494b28864d5de75379beec"
format_stamp: "Formatted at 2026-08-11 19:01:44 on dist-test-slave-gjw7"
server_key: "db5037255df78caf436c33caa069db51"
server_key_iv: "d1fb227fde7cf53b4b832e972ef62f8f"
server_key_version: "encryptionkey@0"
I20260811 19:01:44.941630 12322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 19:01:44.942382 12356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:44.942520 12322 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:01:44.942602 12322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "1e71aab9e2494b28864d5de75379beec"
format_stamp: "Formatted at 2026-08-11 19:01:44 on dist-test-slave-gjw7"
server_key: "db5037255df78caf436c33caa069db51"
server_key_iv: "d1fb227fde7cf53b4b832e972ef62f8f"
server_key_version: "encryptionkey@0"
I20260811 19:01:44.942668 12322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:44.950310 12322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:44.951892 12322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:44.952011 12322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:44.952193 12322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:44.952476 12322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:44.952517 12322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:44.952538 12322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:44.952560 12322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:44.958197 12322 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:38345
I20260811 19:01:44.958240 12573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:38345 every 8 connection(s)
I20260811 19:01:44.958541 12322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 19:01:44.958961 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 12322
I20260811 19:01:44.959069 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 19:01:44.959242 6025 external_mini_cluster.cc:1428] Setting key f17a1d0f77dda685694619e08a43f17b
Aug 11 19:01:44 dist-test-slave-gjw7 krb5kdc[11837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474904, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.66@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:01:44.968310 12009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:44.959844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:58231 (local address 127.5.226.126:40073)
0811 19:01:44.959885 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:44.959887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:44.960149 (+ 262us) server_negotiation.cc:407] Connection header received
0811 19:01:44.960609 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:44.960610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:44.960624 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:44.960689 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:44.961631 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:44.962128 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:44.963092 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:44.963291 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:44.963347 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:44.965648 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:44.965650 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:44.965650 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:44.965657 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:44.966941 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:44.967390 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:44.967391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:44.967392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:44.967445 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:44.967711 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:44.967712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:44.967712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:44.967813 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:44.967860 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:44.968181 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 19:01:44.968244 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
WARNING: no policy specified for kudu/127.5.226.67@KRBTEST.COM; defaulting to no policy
I20260811 19:01:44.968568 12577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:44.959840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40073 (local address 127.5.226.66:58231)
0811 19:01:44.960022 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:44.960064 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:44.960523 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:44.960741 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:44.960744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:44.961327 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:44.961538 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:44.961544 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:44.962212 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:44.962213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:44.963009 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:44.963011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:44.963360 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:44.963361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:44.963483 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:44.964013 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:44.964021 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:44.965556 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:44.967016 (+ 1460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:44.967025 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:44.967028 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:44.967318 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:44.967508 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:44.967509 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:44.967509 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:44.967649 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:44.967871 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:44.967879 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:44.968054 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 19:01:44.968169 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 19:01:44.968339 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":97,"threads_started":1}
I20260811 19:01:44.969121 12574 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40073
I20260811 19:01:44.969211 12574 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:44.969419 12574 heartbeater.cc:511] Master 127.5.226.126:40073 requested a full tablet report, sending...
I20260811 19:01:44.969800 11916 ts_manager.cc:194] Registered new tserver with Master: 1e71aab9e2494b28864d5de75379beec (127.5.226.66:38345)
I20260811 19:01:44.970171 11916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.66@KRBTEST.COM'} at 127.5.226.66:58231
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
Entry for principal kudu/127.5.226.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab.
I20260811 19:01:44.985617 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40073
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:45.068516 12586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:45.068733 12586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:45.068758 12586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:45.069892 12586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:45.069931 12586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:45.069958 12586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 19:01:45.071421 12586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.67.keytab
--principal=kudu/127.5.226.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:40073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:45.071626 12586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:45.071830 12586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:45.076648 12606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:45.076647 12597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:45.076666 12602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:45.076866 12586 server_base.cc:1034] running on GCE node
I20260811 19:01:45.077111 12586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:45.077348 12586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:45.078492 12586 hybrid_clock.cc:648] HybridClock initialized: now 1786474905078476 us; error 27 us; skew 500 ppm
Aug 11 19:01:45 dist-test-slave-gjw7 krb5kdc[11837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474905, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:45.080858 12586 init.cc:377] Logged in from keytab as kudu/127.5.226.67@KRBTEST.COM (short username kudu)
I20260811 19:01:45.081310 12586 webserver.cc:460] Webserver started at http://127.5.226.67:38253/ using document root <none> and password file <none>
I20260811 19:01:45.081516 12586 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:45.081557 12586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:45.081643 12586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:45.082629 12586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "a2664cafc12a4fe3ae474a702c33fce4"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "627a2fdcfd8d55672e5de121e8a6cb8b"
server_key_iv: "d696f81a945ff5abaacee4eacf485591"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.082931 12586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "a2664cafc12a4fe3ae474a702c33fce4"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "627a2fdcfd8d55672e5de121e8a6cb8b"
server_key_iv: "d696f81a945ff5abaacee4eacf485591"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.084084 12586 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 19:01:45.084731 12624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:45.084896 12586 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:45.084980 12586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "a2664cafc12a4fe3ae474a702c33fce4"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "627a2fdcfd8d55672e5de121e8a6cb8b"
server_key_iv: "d696f81a945ff5abaacee4eacf485591"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.085034 12586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:45.106163 12586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:45.108304 12586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:45.108415 12586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:45.108600 12586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:45.108907 12586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:45.108942 12586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:45.108965 12586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:45.108989 12586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:45.114497 12586 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:37013
I20260811 19:01:45.114560 12844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:37013 every 8 connection(s)
I20260811 19:01:45.114858 12586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
Aug 11 19:01:45 dist-test-slave-gjw7 krb5kdc[11837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474905, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.67@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:01:45.121239 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 12586
I20260811 19:01:45.121382 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 19:01:45.121605 6025 external_mini_cluster.cc:1428] Setting key 485005f6d7a77f4d0477cb0bc28ce1a1
I20260811 19:01:45.123814 12009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.115530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:54981 (local address 127.5.226.126:40073)
0811 19:01:45.115587 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:45.115589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:45.115790 (+ 201us) server_negotiation.cc:407] Connection header received
0811 19:01:45.116321 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:45.116323 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:45.116335 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:45.116386 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:45.117351 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.117864 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.118825 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.119034 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.119091 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.121084 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:45.121086 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:45.121086 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:45.121095 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:45.122640 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:45.123066 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:45.123067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:45.123067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:45.123123 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:45.123315 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:45.123316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:45.123316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:45.123416 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:45.123463 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:45.123673 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 19:01:45.123750 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 19:01:45.123967 12848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.115504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:40073 (local address 127.5.226.67:54981)
0811 19:01:45.115671 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:45.115710 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:45.116225 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:45.116457 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:45.116460 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:45.117024 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:45.117232 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.117238 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.117952 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.117953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.118741 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.118743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.119106 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.119107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.119232 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.119694 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:01:45.119702 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:45.120975 (+ 1273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:45.122720 (+ 1745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:45.122728 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:45.122730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:45.122982 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:45.123175 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:01:45.123176 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:01:45.123176 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:01:45.123271 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:01:45.123459 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:45.123462 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:45.123574 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 19:01:45.123650 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 19:01:45.123772 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":87,"threads_started":1}
I20260811 19:01:45.124439 12845 heartbeater.cc:347] Connected to a master server at 127.5.226.126:40073
I20260811 19:01:45.124536 12845 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:45.124716 12845 heartbeater.cc:511] Master 127.5.226.126:40073 requested a full tablet report, sending...
I20260811 19:01:45.125066 11916 ts_manager.cc:194] Registered new tserver with Master: a2664cafc12a4fe3ae474a702c33fce4 (127.5.226.67:37013)
I20260811 19:01:45.125495 11916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.226.67@KRBTEST.COM'} at 127.5.226.67:54981
I20260811 19:01:45.133548 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 19:01:45.140337 12009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.134938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44432 (local address 127.5.226.126:40073)
0811 19:01:45.134989 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:45.134991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:45.135083 (+ 92us) server_negotiation.cc:407] Connection header received
0811 19:01:45.135158 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:45.135159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:45.135167 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:45.135201 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:45.135753 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.136234 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.136927 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.137103 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.137151 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.138328 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:45.138329 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:45.138329 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:45.138336 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:45.139474 (+ 1138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:45.139759 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:45.139760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:45.139760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:45.139805 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:45.139943 (+ 138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:45.139943 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:45.139944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:45.140075 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:45.140149 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:45.140214 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 19:01:45.140276 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 19:01:45.141813 11916 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44432:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 19:01:45.143486 11916 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 19:01:45.149793 12858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.145617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:38345 (local address 127.0.0.1:54004)
0811 19:01:45.146155 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:45.146163 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:45.146199 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:45.146493 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:45.146494 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:45.146496 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:45.146556 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.146558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.147400 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.147401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.148552 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.148555 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.149468 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.149469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.149563 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.149597 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 19:01:45.149665 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 19:01:45.149716 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":56,"threads_started":1}
I20260811 19:01:45.149887 12863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.145886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54004 (local address 127.5.226.66:38345)
0811 19:01:45.146083 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:45.146086 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:45.146247 (+ 161us) server_negotiation.cc:407] Connection header received
0811 19:01:45.146312 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:45.146314 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:45.146330 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:45.146409 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:45.146615 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.147302 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.148647 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.149389 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.149464 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.149528 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:45.149721 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 19:01:45.149794 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":89,"threads_started":1}
I20260811 19:01:45.150044 12860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.145598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:37013 (local address 127.0.0.1:36374)
0811 19:01:45.145848 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:45.145891 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:45.145959 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:45.146301 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:45.146305 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:45.146308 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:45.146425 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.146429 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.147772 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.147773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.148797 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.148799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.149805 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.149806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.149884 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.149889 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 19:01:45.149933 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 19:01:45.149975 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":54,"threads_started":1}
I20260811 19:01:45.150291 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.145851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36374 (local address 127.5.226.67:37013)
0811 19:01:45.146045 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:45.146050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:45.146061 (+ 11us) server_negotiation.cc:407] Connection header received
0811 19:01:45.146103 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:45.146105 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:45.146122 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:45.146201 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:45.146510 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.147666 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.148865 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.149624 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.149684 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.150145 (+ 461us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:45.150174 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 19:01:45.150217 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":103,"threads_started":1}
I20260811 19:01:45.150805 12433 tablet_service.cc:1467] Processing CreateTablet for tablet 1b34d9a3d51b4ec888486f28231db456 (DEFAULT_TABLE table=test-table [id=a0384807107f4986ae4638f7ada001c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:45.150969 12859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.145598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:42311 (local address 127.0.0.1:33484)
0811 19:01:45.146054 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:45.146062 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:45.146094 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:45.146500 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:45.146501 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:45.146503 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:45.146547 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.146549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.148870 (+ 2321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.148871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.149721 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.149723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.150733 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.150734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.150805 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.150809 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:01:45.150856 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 19:01:45.150904 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"mutex_wait_us":2,"thread_start_us":53,"threads_started":1}
I20260811 19:01:45.151147 12866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.146078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33484 (local address 127.5.226.65:42311)
0811 19:01:45.146266 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:45.146269 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:45.146279 (+ 10us) server_negotiation.cc:407] Connection header received
0811 19:01:45.146315 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:45.146317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:45.146341 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:45.146415 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:45.146618 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.147666 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.149807 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.150560 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.150629 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.150687 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:45.150882 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 19:01:45.150923 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":89,"threads_started":1}
I20260811 19:01:45.151221 12433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b34d9a3d51b4ec888486f28231db456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:45.151127 12714 tablet_service.cc:1467] Processing CreateTablet for tablet 1b34d9a3d51b4ec888486f28231db456 (DEFAULT_TABLE table=test-table [id=a0384807107f4986ae4638f7ada001c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:45.151434 12714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b34d9a3d51b4ec888486f28231db456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:45.153832 12185 tablet_service.cc:1467] Processing CreateTablet for tablet 1b34d9a3d51b4ec888486f28231db456 (DEFAULT_TABLE table=test-table [id=a0384807107f4986ae4638f7ada001c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:45.154122 12185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b34d9a3d51b4ec888486f28231db456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:45.154626 12869 tablet_bootstrap.cc:492] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec: Bootstrap starting.
I20260811 19:01:45.155339 12869 tablet_bootstrap.cc:654] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:45.155932 12869 log.cc:824] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:45.156286 12870 tablet_bootstrap.cc:492] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4: Bootstrap starting.
I20260811 19:01:45.156615 12869 tablet_bootstrap.cc:492] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec: No bootstrap required, opened a new log
I20260811 19:01:45.156678 12869 ts_tablet_manager.cc:1397] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:01:45.156944 12870 tablet_bootstrap.cc:654] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:45.157389 12872 tablet_bootstrap.cc:492] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0: Bootstrap starting.
I20260811 19:01:45.157527 12870 log.cc:824] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:45.158180 12872 tablet_bootstrap.cc:654] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:45.158253 12870 tablet_bootstrap.cc:492] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4: No bootstrap required, opened a new log
I20260811 19:01:45.158316 12870 ts_tablet_manager.cc:1397] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:01:45.158537 12869 raft_consensus.cc:348] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42311 } } peers { permanent_uuid: "1e71aab9e2494b28864d5de75379beec" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38345 } } peers { permanent_uuid: "a2664cafc12a4fe3ae474a702c33fce4" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37013 } }
I20260811 19:01:45.158730 12869 raft_consensus.cc:374] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:45.158759 12872 log.cc:824] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:45.158776 12869 raft_consensus.cc:729] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e71aab9e2494b28864d5de75379beec, State: Initialized, Role: FOLLOWER
I20260811 19:01:45.158905 12869 consensus_queue.cc:260] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42311 } } peers { permanent_uuid: "1e71aab9e2494b28864d5de75379beec" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38345 } } peers { permanent_uuid: "a2664cafc12a4fe3ae474a702c33fce4" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37013 } }
I20260811 19:01:45.159193 12869 ts_tablet_manager.cc:1428] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 19:01:45.159317 12574 heartbeater.cc:503] Master 127.5.226.126:40073 was elected leader, sending a full tablet report...
I20260811 19:01:45.159790 12872 tablet_bootstrap.cc:492] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0: No bootstrap required, opened a new log
I20260811 19:01:45.159861 12872 ts_tablet_manager.cc:1397] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 19:01:45.159911 12870 raft_consensus.cc:348] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42311 } } peers { permanent_uuid: "1e71aab9e2494b28864d5de75379beec" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38345 } } peers { permanent_uuid: "a2664cafc12a4fe3ae474a702c33fce4" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37013 } }
I20260811 19:01:45.160074 12870 raft_consensus.cc:374] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:45.160116 12870 raft_consensus.cc:729] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2664cafc12a4fe3ae474a702c33fce4, State: Initialized, Role: FOLLOWER
I20260811 19:01:45.160224 12870 consensus_queue.cc:260] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42311 } } peers { permanent_uuid: "1e71aab9e2494b28864d5de75379beec" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38345 } } peers { permanent_uuid: "a2664cafc12a4fe3ae474a702c33fce4" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37013 } }
I20260811 19:01:45.160501 12870 ts_tablet_manager.cc:1428] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:01:45.160523 12845 heartbeater.cc:503] Master 127.5.226.126:40073 was elected leader, sending a full tablet report...
I20260811 19:01:45.161638 12872 raft_consensus.cc:348] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42311 } } peers { permanent_uuid: "1e71aab9e2494b28864d5de75379beec" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38345 } } peers { permanent_uuid: "a2664cafc12a4fe3ae474a702c33fce4" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37013 } }
I20260811 19:01:45.161770 12872 raft_consensus.cc:374] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:45.161790 12872 raft_consensus.cc:729] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bebdf677f68b4ecb916c35c9fc0f19b0, State: Initialized, Role: FOLLOWER
I20260811 19:01:45.161868 12872 consensus_queue.cc:260] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42311 } } peers { permanent_uuid: "1e71aab9e2494b28864d5de75379beec" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38345 } } peers { permanent_uuid: "a2664cafc12a4fe3ae474a702c33fce4" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37013 } }
I20260811 19:01:45.162058 12872 ts_tablet_manager.cc:1428] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:01:45.162096 12313 heartbeater.cc:503] Master 127.5.226.126:40073 was elected leader, sending a full tablet report...
W20260811 19:01:45.209084 12576 tablet.cc:2369] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 19:01:45.317764 12316 tablet.cc:2369] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:01:45.332568 12881 raft_consensus.cc:482] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:01:45.332713 12881 raft_consensus.cc:504] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42311 } } peers { permanent_uuid: "1e71aab9e2494b28864d5de75379beec" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38345 } } peers { permanent_uuid: "a2664cafc12a4fe3ae474a702c33fce4" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37013 } }
I20260811 19:01:45.333066 12881 leader_election.cc:288] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e71aab9e2494b28864d5de75379beec (127.5.226.66:38345), a2664cafc12a4fe3ae474a702c33fce4 (127.5.226.67:37013)
I20260811 19:01:45.336146 12863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.333352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:60371 (local address 127.5.226.66:38345)
0811 19:01:45.333414 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:45.333417 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:45.333546 (+ 129us) server_negotiation.cc:407] Connection header received
0811 19:01:45.333618 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:45.333619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:45.333629 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:45.333681 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:45.333908 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.334418 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.335438 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.335809 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.335875 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.335883 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:45.336035 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 19:01:45.336078 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 19:01:45.336187 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.333394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:32833 (local address 127.5.226.67:37013)
0811 19:01:45.333441 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:45.333442 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:45.333506 (+ 64us) server_negotiation.cc:407] Connection header received
0811 19:01:45.333564 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:45.333565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:45.333576 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:45.333622 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:45.333814 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.334373 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.335443 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.335854 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.335941 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.335950 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:45.336090 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 19:01:45.336128 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 19:01:45.336171 12884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.333273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:38345 (local address 127.5.226.65:60371)
0811 19:01:45.333467 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:45.333478 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:45.333551 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:45.333695 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:45.333695 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:45.333697 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:45.333772 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.333774 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.334503 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.334504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.335349 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.335352 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.335885 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.335886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.335964 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.335969 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 19:01:45.336018 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 19:01:45.336056 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":2,"thread_start_us":108,"threads_started":1}
I20260811 19:01:45.336184 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.333267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:37013 (local address 127.5.226.65:32833)
0811 19:01:45.333430 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:45.333440 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:45.333500 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:45.333643 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:45.333644 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:45.333646 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:45.333743 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.333745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.334449 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.334450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.335342 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.335344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.335961 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.335962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.336022 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.336027 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 19:01:45.336075 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 19:01:45.336113 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":100,"threads_started":1}
I20260811 19:01:45.336615 12479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b34d9a3d51b4ec888486f28231db456" candidate_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e71aab9e2494b28864d5de75379beec" is_pre_election: true
I20260811 19:01:45.336615 12754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b34d9a3d51b4ec888486f28231db456" candidate_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2664cafc12a4fe3ae474a702c33fce4" is_pre_election: true
I20260811 19:01:45.336782 12479 raft_consensus.cc:2454] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bebdf677f68b4ecb916c35c9fc0f19b0 in term 0.
I20260811 19:01:45.336782 12754 raft_consensus.cc:2454] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bebdf677f68b4ecb916c35c9fc0f19b0 in term 0.
I20260811 19:01:45.337028 12099 leader_election.cc:302] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e71aab9e2494b28864d5de75379beec, bebdf677f68b4ecb916c35c9fc0f19b0; no voters:
I20260811 19:01:45.337172 12881 raft_consensus.cc:2781] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 19:01:45.337256 12881 raft_consensus.cc:482] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 19:01:45.337280 12881 raft_consensus.cc:3037] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:45.338079 12881 raft_consensus.cc:504] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42311 } } peers { permanent_uuid: "1e71aab9e2494b28864d5de75379beec" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38345 } } peers { permanent_uuid: "a2664cafc12a4fe3ae474a702c33fce4" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37013 } }
I20260811 19:01:45.338225 12881 leader_election.cc:288] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1e71aab9e2494b28864d5de75379beec (127.5.226.66:38345), a2664cafc12a4fe3ae474a702c33fce4 (127.5.226.67:37013)
I20260811 19:01:45.338357 12479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b34d9a3d51b4ec888486f28231db456" candidate_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e71aab9e2494b28864d5de75379beec"
I20260811 19:01:45.338379 12754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b34d9a3d51b4ec888486f28231db456" candidate_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2664cafc12a4fe3ae474a702c33fce4"
I20260811 19:01:45.338449 12479 raft_consensus.cc:3037] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:45.338457 12754 raft_consensus.cc:3037] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:45.339154 12754 raft_consensus.cc:2454] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bebdf677f68b4ecb916c35c9fc0f19b0 in term 1.
I20260811 19:01:45.339282 12479 raft_consensus.cc:2454] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bebdf677f68b4ecb916c35c9fc0f19b0 in term 1.
I20260811 19:01:45.339320 12094 leader_election.cc:302] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2664cafc12a4fe3ae474a702c33fce4, bebdf677f68b4ecb916c35c9fc0f19b0; no voters:
I20260811 19:01:45.339404 12881 raft_consensus.cc:2781] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:45.339584 12881 raft_consensus.cc:686] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [term 1 LEADER]: Becoming Leader. State: Replica: bebdf677f68b4ecb916c35c9fc0f19b0, State: Running, Role: LEADER
I20260811 19:01:45.339697 12881 consensus_queue.cc:237] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42311 } } peers { permanent_uuid: "1e71aab9e2494b28864d5de75379beec" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38345 } } peers { permanent_uuid: "a2664cafc12a4fe3ae474a702c33fce4" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37013 } }
I20260811 19:01:45.340601 11916 catalog_manager.cc:5495] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bebdf677f68b4ecb916c35c9fc0f19b0 (127.5.226.65). New cstate: current_term: 1 leader_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebdf677f68b4ecb916c35c9fc0f19b0" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 42311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e71aab9e2494b28864d5de75379beec" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2664cafc12a4fe3ae474a702c33fce4" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37013 } health_report { overall_health: UNKNOWN } } }
W20260811 19:01:45.365432 12846 tablet.cc:2369] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:01:45.377947 12866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.375601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33500 (local address 127.5.226.65:42311)
0811 19:01:45.375667 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:45.375669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:45.375678 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:01:45.375725 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:45.375726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:45.375749 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:45.375809 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:01:45.375946 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.376421 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.377152 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.377408 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.377468 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.377615 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:01:45.377727 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:01:45.377800 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:45.377839 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 19:01:45.377869 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 19:01:45.379673 12479 raft_consensus.cc:1261] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec [term 1 FOLLOWER]: Refusing update from remote peer bebdf677f68b4ecb916c35c9fc0f19b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:01:45.379674 12754 raft_consensus.cc:1261] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4 [term 1 FOLLOWER]: Refusing update from remote peer bebdf677f68b4ecb916c35c9fc0f19b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:01:45.380009 12881 consensus_queue.cc:1035] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e71aab9e2494b28864d5de75379beec" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:01:45.380154 12885 consensus_queue.cc:1035] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2664cafc12a4fe3ae474a702c33fce4" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 37013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:01:45.382519 12889 mvcc.cc:205] Tried to move back new op lower bound from 7317401212432662528 to 7317401212272136192. Current Snapshot: MvccSnapshot[applied={T|T < 7317401212432662528}]
I20260811 19:01:45.383347 12890 mvcc.cc:205] Tried to move back new op lower bound from 7317401212432662528 to 7317401212272136192. Current Snapshot: MvccSnapshot[applied={T|T < 7317401212432662528}]
I20260811 19:01:45.384606 11916 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44432:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:01:45.384690 11916 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44432:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:01:45.385368 11916 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3bbd455d1b8b42538a0586be17fa3c8b: Sending DeleteTablet for 3 replicas of tablet 1b34d9a3d51b4ec888486f28231db456
I20260811 19:01:45.385684 12185 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b34d9a3d51b4ec888486f28231db456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:45 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:33484
I20260811 19:01:45.385705 12433 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b34d9a3d51b4ec888486f28231db456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:45 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:54004
I20260811 19:01:45.385710 12714 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b34d9a3d51b4ec888486f28231db456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:45 UTC) from {username='kudu', principal='kudu/127.5.226.126@KRBTEST.COM'} at 127.0.0.1:36374
I20260811 19:01:45.385977 12906 tablet_replica.cc:330] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec: stopping tablet replica
I20260811 19:01:45.386073 12904 tablet_replica.cc:330] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0: stopping tablet replica
I20260811 19:01:45.386127 12906 raft_consensus.cc:2229] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:01:45.386204 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 12060
I20260811 19:01:45.386210 12904 raft_consensus.cc:2229] T 1b34d9a3d51b4ec888486f28231db456 P bebdf677f68b4ecb916c35c9fc0f19b0 [term 1 LEADER]: Raft consensus shutting down.
I20260811 19:01:45.386823 12906 raft_consensus.cc:2258] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:45.393575 12907 tablet_replica.cc:330] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4: stopping tablet replica
I20260811 19:01:45.393729 12907 raft_consensus.cc:2229] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:01:45.393877 12907 raft_consensus.cc:2258] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:45.403143 12907 ts_tablet_manager.cc:1905] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:45.403649 12906 ts_tablet_manager.cc:1905] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:45.404939 12907 ts_tablet_manager.cc:1918] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:45.405026 12907 log.cc:1196] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/1b34d9a3d51b4ec888486f28231db456
I20260811 19:01:45.405387 12907 ts_tablet_manager.cc:1939] T 1b34d9a3d51b4ec888486f28231db456 P a2664cafc12a4fe3ae474a702c33fce4: Deleting consensus metadata
I20260811 19:01:45.405387 12906 ts_tablet_manager.cc:1918] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:45.405457 12906 log.cc:1196] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/1b34d9a3d51b4ec888486f28231db456
I20260811 19:01:45.405752 12906 ts_tablet_manager.cc:1939] T 1b34d9a3d51b4ec888486f28231db456 P 1e71aab9e2494b28864d5de75379beec: Deleting consensus metadata
I20260811 19:01:45.405961 11886 catalog_manager.cc:4841] TS a2664cafc12a4fe3ae474a702c33fce4 (127.5.226.67:37013): tablet 1b34d9a3d51b4ec888486f28231db456 (table test-table [id=a0384807107f4986ae4638f7ada001c2]) successfully deleted
I20260811 19:01:45.406188 11888 catalog_manager.cc:4841] TS 1e71aab9e2494b28864d5de75379beec (127.5.226.66:38345): tablet 1b34d9a3d51b4ec888486f28231db456 (table test-table [id=a0384807107f4986ae4638f7ada001c2]) successfully deleted
W20260811 19:01:45.407949 11893 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:42311 (error 108)
I20260811 19:01:45.408146 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 12322
I20260811 19:01:45.417564 12859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.408297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:42311 (local address 127.0.0.1:33504)
0811 19:01:45.417416 (+ 9119us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:45.417514 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:42311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9073}
W20260811 19:01:45.422065 11893 catalog_manager.cc:4584] TS bebdf677f68b4ecb916c35c9fc0f19b0 (127.5.226.65:42311): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1b34d9a3d51b4ec888486f28231db456: Network error: Client connection negotiation failed: client connection to 127.5.226.65:42311: connect: Connection refused (error 111)
I20260811 19:01:45.426532 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 12586
I20260811 19:01:45.441449 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 11854
2026-08-11T19:01:45Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2301 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T19:01:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:45Z Disabled control of system clock
I20260811 19:01:45.475966 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:33917
--webserver_interface=127.5.226.126
--webserver_port=0
--builtin_ntp_servers=127.5.226.84:42477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:33917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 19:01:45.556141 12913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:45.556355 12913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:45.556389 12913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:45.557525 12913 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:45.557564 12913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:45.557579 12913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:45.557595 12913 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:45.557608 12913 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:45.558908 12913 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:33917
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:33917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:45.559149 12913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:45.559412 12913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:45.563874 12931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:45.563897 12919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:45.563865 12923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:45.564136 12913 server_base.cc:1034] running on GCE node
I20260811 19:01:45.564379 12913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:45.564628 12913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:45.565769 12913 hybrid_clock.cc:648] HybridClock initialized: now 1786474905565751 us; error 27 us; skew 500 ppm
I20260811 19:01:45.566958 12913 webserver.cc:460] Webserver started at http://127.5.226.126:38653/ using document root <none> and password file <none>
I20260811 19:01:45.567168 12913 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:45.567230 12913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:45.567368 12913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:45.568385 12913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "6cf6fc616ee0420d90685bf262b69a29"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "5177af46af6576bb9542c150f2050c2a"
server_key_iv: "9a17fdb376cf85451968176dffdacbce"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.568676 12913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "6cf6fc616ee0420d90685bf262b69a29"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "5177af46af6576bb9542c150f2050c2a"
server_key_iv: "9a17fdb376cf85451968176dffdacbce"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.569898 12913 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 19:01:45.570535 12943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:45.570678 12913 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:45.570760 12913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "6cf6fc616ee0420d90685bf262b69a29"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "5177af46af6576bb9542c150f2050c2a"
server_key_iv: "9a17fdb376cf85451968176dffdacbce"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.570840 12913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:45.579593 12913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:45.579898 12913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:45.580004 12913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:45.583787 12913 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:33917
I20260811 19:01:45.583822 13036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:33917 every 8 connection(s)
I20260811 19:01:45.584139 12913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:45.585086 13039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:45.587395 13039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29: Bootstrap starting.
I20260811 19:01:45.587965 13039 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:45.588232 13039 log.cc:824] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:45.588872 13039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29: No bootstrap required, opened a new log
I20260811 19:01:45.589917 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 12913
I20260811 19:01:45.590008 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:45.590176 6025 external_mini_cluster.cc:1428] Setting key 7b5d856c854f5c91bf68eb7ad82f2600
I20260811 19:01:45.590641 13039 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cf6fc616ee0420d90685bf262b69a29" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33917 } }
I20260811 19:01:45.590893 13039 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:45.590952 13039 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf6fc616ee0420d90685bf262b69a29, State: Initialized, Role: FOLLOWER
I20260811 19:01:45.591073 13039 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cf6fc616ee0420d90685bf262b69a29" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33917 } }
I20260811 19:01:45.591154 13039 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:45.591189 13039 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:45.591236 13039 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:45.591831 13039 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cf6fc616ee0420d90685bf262b69a29" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33917 } }
I20260811 19:01:45.591931 13039 leader_election.cc:302] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cf6fc616ee0420d90685bf262b69a29; no voters:
I20260811 19:01:45.592089 13039 leader_election.cc:288] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:45.592139 13044 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:45.592298 13044 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf6fc616ee0420d90685bf262b69a29, State: Running, Role: LEADER
I20260811 19:01:45.592360 13039 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:45.592394 13044 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cf6fc616ee0420d90685bf262b69a29" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33917 } }
I20260811 19:01:45.592738 13044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cf6fc616ee0420d90685bf262b69a29. Latest consensus state: current_term: 1 leader_uuid: "6cf6fc616ee0420d90685bf262b69a29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cf6fc616ee0420d90685bf262b69a29" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33917 } } }
I20260811 19:01:45.592805 13048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6cf6fc616ee0420d90685bf262b69a29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cf6fc616ee0420d90685bf262b69a29" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 33917 } } }
I20260811 19:01:45.592885 13044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:45.592892 13048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:45.593204 13061 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:45.593801 13061 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:45.595482 13061 catalog_manager.cc:1347] Generated new cluster ID: d34859ba0ef949c8a4bffab5e79ab6c4
I20260811 19:01:45.595535 13061 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:45.598227 13043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.590682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53206 (local address 127.5.226.126:33917)
0811 19:01:45.590912 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:45.590921 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:45.590956 (+ 35us) server_negotiation.cc:407] Connection header received
0811 19:01:45.591073 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:45.591080 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:45.591150 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:45.591291 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:45.591663 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.593308 (+ 1645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.594394 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.595036 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.595151 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.597529 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:45.597533 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:45.597534 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:45.597741 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:45.597785 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:45.597801 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:45.597871 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:45.597938 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 19:01:45.598021 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
I20260811 19:01:45.608840 13061 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:45.609344 13061 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:45.619794 13061 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29: Generated new TSK 0
I20260811 19:01:45.620015 13061 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:01:45.624409 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.65:0
--local_ip_for_outbound_sockets=127.5.226.65
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33917
--builtin_ntp_servers=127.5.226.84:42477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 19:01:45.706475 13077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:45.706676 13077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:45.706697 13077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:45.707814 13077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:45.707863 13077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:45.707888 13077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.65
I20260811 19:01:45.709219 13077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.226.65
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.65
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:45.709486 13077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:45.709771 13077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:45.715490 13095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:45.715513 13077 server_base.cc:1034] running on GCE node
W20260811 19:01:45.715540 13092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:45.715602 13093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:45.715858 13077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:45.716109 13077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:45.717242 13077 hybrid_clock.cc:648] HybridClock initialized: now 1786474905717228 us; error 33 us; skew 500 ppm
I20260811 19:01:45.718420 13077 webserver.cc:460] Webserver started at http://127.5.226.65:33101/ using document root <none> and password file <none>
I20260811 19:01:45.718657 13077 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:45.718703 13077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:45.718837 13077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:45.719916 13077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/data/instance:
uuid: "0610621fc8d2439a8df14736f3c35334"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "8db1cba105431292a366b748cab21bd0"
server_key_iv: "ac98bda7ffc4078b08e11dbf94f0acd6"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.720252 13077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance:
uuid: "0610621fc8d2439a8df14736f3c35334"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "8db1cba105431292a366b748cab21bd0"
server_key_iv: "ac98bda7ffc4078b08e11dbf94f0acd6"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.721503 13077 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 19:01:45.722165 13103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:45.722323 13077 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:45.722409 13077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/wal
uuid: "0610621fc8d2439a8df14736f3c35334"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "8db1cba105431292a366b748cab21bd0"
server_key_iv: "ac98bda7ffc4078b08e11dbf94f0acd6"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.722463 13077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:45.757133 13077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:45.757457 13077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:45.757567 13077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:45.757763 13077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:45.758066 13077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:45.758096 13077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:45.758123 13077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:45.758140 13077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:45.763801 13077 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.65:38089
I20260811 19:01:45.763844 13322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.65:38089 every 8 connection(s)
I20260811 19:01:45.764173 13077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/data/info.pb
I20260811 19:01:45.769244 13043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.764838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:37957 (local address 127.5.226.126:33917)
0811 19:01:45.764901 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:45.764903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:45.765119 (+ 216us) server_negotiation.cc:407] Connection header received
0811 19:01:45.765689 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:45.765691 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:45.765708 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:45.765759 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:45.766439 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.766950 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.767958 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.768154 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.768209 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.768984 (+ 775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:45.768986 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:45.768986 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:45.768991 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:45.769009 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:45.769013 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:45.769057 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:45.769129 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 19:01:45.769164 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 19:01:45.769474 13326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.764823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33917 (local address 127.5.226.65:37957)
0811 19:01:45.765006 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:45.765040 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:45.765589 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:45.765831 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:45.765835 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:45.765845 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:45.766342 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.766347 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.767033 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.767034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.767875 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.767878 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.768223 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.768224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.768360 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.768847 (+ 487us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 19:01:45.768847 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:45.768879 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 19:01:45.768902 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:45.769063 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:45.769068 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:45.769071 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:01:45.769133 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 19:01:45.769233 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":73,"threads_started":1}
I20260811 19:01:45.769934 13323 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33917
I20260811 19:01:45.770017 13323 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:45.770191 13323 heartbeater.cc:511] Master 127.5.226.126:33917 requested a full tablet report, sending...
I20260811 19:01:45.770259 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 13077
I20260811 19:01:45.770371 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-0/wal/instance
I20260811 19:01:45.770574 6025 external_mini_cluster.cc:1428] Setting key a79be18b2f6938b8894c9d62e09831fa
I20260811 19:01:45.770723 12980 ts_manager.cc:194] Registered new tserver with Master: 0610621fc8d2439a8df14736f3c35334 (127.5.226.65:38089)
I20260811 19:01:45.771570 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.66:0
--local_ip_for_outbound_sockets=127.5.226.66
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33917
--builtin_ntp_servers=127.5.226.84:42477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 19:01:45.771554 12980 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.226.65:37957
W20260811 19:01:45.852663 13327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:45.852850 13327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:45.852870 13327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:45.853955 13327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:45.853987 13327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:45.854010 13327 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.66
I20260811 19:01:45.855266 13327 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.226.66
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.66
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:45.855449 13327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:45.855675 13327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:45.860280 13339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:45.860280 13341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:45.860298 13337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:45.860508 13327 server_base.cc:1034] running on GCE node
I20260811 19:01:45.860700 13327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:45.860927 13327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:45.862069 13327 hybrid_clock.cc:648] HybridClock initialized: now 1786474905862054 us; error 27 us; skew 500 ppm
I20260811 19:01:45.863200 13327 webserver.cc:460] Webserver started at http://127.5.226.66:37793/ using document root <none> and password file <none>
I20260811 19:01:45.863404 13327 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:45.863451 13327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:45.863579 13327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:45.864670 13327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/data/instance:
uuid: "78ae02eb854840a7b5062b47c29b0b6a"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "100a2bdf13dbcc77b8ff78510c743c41"
server_key_iv: "5ff579e38fc9363ff05f378fd1b1596d"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.865005 13327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance:
uuid: "78ae02eb854840a7b5062b47c29b0b6a"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "100a2bdf13dbcc77b8ff78510c743c41"
server_key_iv: "5ff579e38fc9363ff05f378fd1b1596d"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.866240 13327 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 19:01:45.866894 13354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:45.867036 13327 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:01:45.867120 13327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/wal
uuid: "78ae02eb854840a7b5062b47c29b0b6a"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "100a2bdf13dbcc77b8ff78510c743c41"
server_key_iv: "5ff579e38fc9363ff05f378fd1b1596d"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.867180 13327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:45.873674 13327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:45.873919 13327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:45.874038 13327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:45.874233 13327 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:45.874524 13327 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:45.874557 13327 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:45.874583 13327 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:45.874606 13327 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:45.880398 13327 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.66:42343
I20260811 19:01:45.880473 13588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.66:42343 every 8 connection(s)
I20260811 19:01:45.880759 13327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/data/info.pb
I20260811 19:01:45.886828 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 13327
I20260811 19:01:45.886940 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/wal/instance
I20260811 19:01:45.887125 6025 external_mini_cluster.cc:1428] Setting key 3a2001f539f1e65d92d5527b265e166b
I20260811 19:01:45.887120 13043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.881562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.66:46403 (local address 127.5.226.126:33917)
0811 19:01:45.881645 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:45.881647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:45.882559 (+ 912us) server_negotiation.cc:407] Connection header received
0811 19:01:45.883171 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:45.883173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:45.883186 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:45.883238 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:45.884055 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.884828 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.885852 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.886053 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.886111 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.886813 (+ 702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:45.886815 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:45.886815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:45.886820 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:45.886836 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:45.886841 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:45.886887 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:45.887009 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 19:01:45.887040 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 19:01:45.887312 13595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:45.881527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33917 (local address 127.5.226.66:46403)
0811 19:01:45.882430 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:45.882475 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:45.883068 (+ 593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:45.883310 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:45.883314 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:45.883325 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:45.883960 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.883968 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.884928 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.884929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.885777 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:45.885780 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:45.886118 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:45.886119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:45.886223 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:45.886680 (+ 457us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 19:01:45.886681 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:45.886708 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 19:01:45.886731 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:45.886893 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:45.886900 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:45.886903 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:01:45.886995 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 19:01:45.887100 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"thread_start_us":77,"threads_started":1}
I20260811 19:01:45.887916 13589 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33917
I20260811 19:01:45.888001 13589 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:45.888075 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.226.67:0
--local_ip_for_outbound_sockets=127.5.226.67
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33917
--builtin_ntp_servers=127.5.226.84:42477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 19:01:45.888197 13589 heartbeater.cc:511] Master 127.5.226.126:33917 requested a full tablet report, sending...
I20260811 19:01:45.888562 12980 ts_manager.cc:194] Registered new tserver with Master: 78ae02eb854840a7b5062b47c29b0b6a (127.5.226.66:42343)
I20260811 19:01:45.888926 12980 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.226.66:46403
W20260811 19:01:45.968933 13597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:45.969134 13597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:45.969163 13597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:45.970335 13597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:45.970382 13597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:45.970415 13597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.226.67
I20260811 19:01:45.971781 13597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.226.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.226.67
--webserver_port=0
--tserver_master_addrs=127.5.226.126:33917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.226.67
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:45.972020 13597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:45.972297 13597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:45.977176 13611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:45.977195 13607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:45.977277 13597 server_base.cc:1034] running on GCE node
W20260811 19:01:45.977172 13609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:45.977622 13597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:45.977877 13597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:45.979040 13597 hybrid_clock.cc:648] HybridClock initialized: now 1786474905979026 us; error 28 us; skew 500 ppm
I20260811 19:01:45.980221 13597 webserver.cc:460] Webserver started at http://127.5.226.67:39237/ using document root <none> and password file <none>
I20260811 19:01:45.980455 13597 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:45.980502 13597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:45.980635 13597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:45.981748 13597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/data/instance:
uuid: "150eef09ea7b41ea8cf1de717914a108"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "42afc3f9997a8584a3bcca33e5b73adf"
server_key_iv: "873044dd2a8dcdf0d2a2cf00c9f8f5bc"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.982090 13597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance:
uuid: "150eef09ea7b41ea8cf1de717914a108"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "42afc3f9997a8584a3bcca33e5b73adf"
server_key_iv: "873044dd2a8dcdf0d2a2cf00c9f8f5bc"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.983295 13597 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 19:01:45.983966 13622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:45.984113 13597 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:45.984196 13597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/wal
uuid: "150eef09ea7b41ea8cf1de717914a108"
format_stamp: "Formatted at 2026-08-11 19:01:45 on dist-test-slave-gjw7"
server_key: "42afc3f9997a8584a3bcca33e5b73adf"
server_key_iv: "873044dd2a8dcdf0d2a2cf00c9f8f5bc"
server_key_version: "encryptionkey@0"
I20260811 19:01:45.984261 13597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:46.009438 13597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:46.009763 13597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:46.009896 13597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:46.010130 13597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 19:01:46.010488 13597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 19:01:46.010532 13597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:46.010556 13597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 19:01:46.010579 13597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:46.016152 13597 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.67:38317
I20260811 19:01:46.016217 13829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.67:38317 every 8 connection(s)
I20260811 19:01:46.016535 13597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/data/info.pb
I20260811 19:01:46.021265 13043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.017250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.67:54825 (local address 127.5.226.126:33917)
0811 19:01:46.017326 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:46.017329 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:46.017577 (+ 248us) server_negotiation.cc:407] Connection header received
0811 19:01:46.018052 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:46.018054 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:46.018064 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:46.018114 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:46.018758 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.019246 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.020140 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.020311 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.020352 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:46.021056 (+ 704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:46.021058 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:46.021058 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:46.021062 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:46.021077 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:46.021081 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:46.021119 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:46.021181 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 19:01:46.021206 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 19:01:46.021482 13835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.017241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:33917 (local address 127.5.226.67:54825)
0811 19:01:46.017456 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:46.017492 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:46.017975 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:46.018172 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:46.018175 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:46.018183 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:01:46.018697 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:46.018701 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.019306 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.019307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:46.020079 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:46.020081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.020376 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.020377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:46.020480 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:46.020931 (+ 451us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 19:01:46.020932 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:01:46.020960 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 19:01:46.020983 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:01:46.021126 (+ 143us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:01:46.021129 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:01:46.021131 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 19:01:46.021175 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 19:01:46.021253 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":120,"threads_started":1}
I20260811 19:01:46.021943 13831 heartbeater.cc:347] Connected to a master server at 127.5.226.126:33917
I20260811 19:01:46.022033 13831 heartbeater.cc:464] Registering TS with master...
I20260811 19:01:46.022217 13831 heartbeater.cc:511] Master 127.5.226.126:33917 requested a full tablet report, sending...
I20260811 19:01:46.022557 12980 ts_manager.cc:194] Registered new tserver with Master: 150eef09ea7b41ea8cf1de717914a108 (127.5.226.67:38317)
I20260811 19:01:46.022918 12980 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.226.67:54825
I20260811 19:01:46.023554 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 13597
I20260811 19:01:46.023661 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/wal/instance
I20260811 19:01:46.023826 6025 external_mini_cluster.cc:1428] Setting key 6885e9d3b350afae8996e019cf9d10f5
I20260811 19:01:46.024639 6025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 19:01:46.028396 13043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.025943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53212 (local address 127.5.226.126:33917)
0811 19:01:46.025992 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:46.025993 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:46.026106 (+ 113us) server_negotiation.cc:407] Connection header received
0811 19:01:46.026153 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:46.026154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:46.026164 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:46.026199 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:46.026339 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.026784 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.027452 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.027621 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.027661 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:46.028225 (+ 564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:46.028226 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:46.028226 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:46.028230 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:46.028239 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:46.028242 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:46.028269 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:46.028310 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 19:01:46.028327 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 19:01:46.029809 12980 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53212:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 19:01:46.031314 12980 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 19:01:46.037259 13850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.033321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:42343 (local address 127.0.0.1:52314)
0811 19:01:46.033502 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:46.033542 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:46.033609 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:46.034073 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:46.034074 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:46.034076 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:46.034105 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:46.034106 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.035048 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.035049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:46.036257 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:46.036260 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.036972 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.036974 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:46.037058 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:46.037071 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 19:01:46.037130 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 19:01:46.037182 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":88,"threads_started":1}
I20260811 19:01:46.037273 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.033508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52314 (local address 127.5.226.66:42343)
0811 19:01:46.033909 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:46.033912 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:46.033921 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:01:46.033956 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:46.033958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:46.033971 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:46.034072 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:46.034168 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.034975 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.036341 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.036899 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.036959 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:46.037053 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:46.037157 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 19:01:46.037191 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":76,"threads_started":1}
I20260811 19:01:46.037626 13852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.033418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:38089 (local address 127.0.0.1:41818)
0811 19:01:46.033743 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:46.033750 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:46.033784 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:46.034319 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:46.034319 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:46.034322 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:46.034380 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:46.034382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.035560 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.035562 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:46.036465 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:46.036468 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.037405 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.037406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:46.037457 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:46.037459 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 19:01:46.037496 (+ 37us) client_negotiation.cc:240] Negotiation successful
0811 19:01:46.037530 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":2,"thread_start_us":100,"threads_started":1}
I20260811 19:01:46.037659 13857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.033583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45192 (local address 127.5.226.67:38317)
0811 19:01:46.033860 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:46.033872 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:46.033880 (+ 8us) server_negotiation.cc:407] Connection header received
0811 19:01:46.033912 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:46.033913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:46.033925 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:46.033988 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:46.034168 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.035243 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.036430 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.037136 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.037204 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:46.037315 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:46.037538 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 19:01:46.037582 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":81,"threads_started":1}
I20260811 19:01:46.038033 13859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.033689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41818 (local address 127.5.226.65:38089)
0811 19:01:46.033858 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:46.033863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:46.033874 (+ 11us) server_negotiation.cc:407] Connection header received
0811 19:01:46.033917 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:46.033920 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:46.033935 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:46.034248 (+ 313us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:46.034463 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.035491 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.036546 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.037231 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.037310 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:46.037879 (+ 569us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:46.037906 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 19:01:46.037948 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":84,"threads_started":1}
I20260811 19:01:46.037626 13854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.033321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:38317 (local address 127.0.0.1:45192)
0811 19:01:46.033564 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:46.033575 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:46.033627 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:46.034014 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:46.034018 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:46.034021 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:46.034084 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:46.034086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.035331 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.035332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:46.036371 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:46.036373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.037367 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.037368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:46.037432 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:46.037436 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:01:46.037489 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 19:01:46.037529 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":2,"thread_start_us":61,"threads_started":1}
I20260811 19:01:46.038319 13451 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba9bbbdc3bf40b59259a6509b730446 (DEFAULT_TABLE table=test-table [id=610ca7cd656341f78aa5c460ab58766f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:46.038726 13451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba9bbbdc3bf40b59259a6509b730446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:46.038759 13720 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba9bbbdc3bf40b59259a6509b730446 (DEFAULT_TABLE table=test-table [id=610ca7cd656341f78aa5c460ab58766f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:46.038790 13202 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba9bbbdc3bf40b59259a6509b730446 (DEFAULT_TABLE table=test-table [id=610ca7cd656341f78aa5c460ab58766f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 19:01:46.039098 13720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba9bbbdc3bf40b59259a6509b730446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:46.039113 13202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba9bbbdc3bf40b59259a6509b730446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:46.041832 13860 tablet_bootstrap.cc:492] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108: Bootstrap starting.
I20260811 19:01:46.042243 13861 tablet_bootstrap.cc:492] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334: Bootstrap starting.
I20260811 19:01:46.042429 13868 tablet_bootstrap.cc:492] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a: Bootstrap starting.
I20260811 19:01:46.042668 13860 tablet_bootstrap.cc:654] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:46.042889 13861 tablet_bootstrap.cc:654] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:46.042994 13868 tablet_bootstrap.cc:654] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:46.043004 13860 log.cc:824] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:46.043198 13861 log.cc:824] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:46.043268 13868 log.cc:824] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:46.043844 13860 tablet_bootstrap.cc:492] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108: No bootstrap required, opened a new log
I20260811 19:01:46.043907 13861 tablet_bootstrap.cc:492] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334: No bootstrap required, opened a new log
I20260811 19:01:46.043923 13860 ts_tablet_manager.cc:1397] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 19:01:46.043936 13868 tablet_bootstrap.cc:492] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a: No bootstrap required, opened a new log
I20260811 19:01:46.043967 13861 ts_tablet_manager.cc:1397] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 19:01:46.043994 13868 ts_tablet_manager.cc:1397] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 19:01:46.045949 13868 raft_consensus.cc:348] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ae02eb854840a7b5062b47c29b0b6a" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42343 } } peers { permanent_uuid: "150eef09ea7b41ea8cf1de717914a108" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 38317 } } peers { permanent_uuid: "0610621fc8d2439a8df14736f3c35334" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 38089 } }
I20260811 19:01:46.046084 13868 raft_consensus.cc:374] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:46.046118 13868 raft_consensus.cc:729] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78ae02eb854840a7b5062b47c29b0b6a, State: Initialized, Role: FOLLOWER
I20260811 19:01:46.046257 13868 consensus_queue.cc:260] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ae02eb854840a7b5062b47c29b0b6a" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42343 } } peers { permanent_uuid: "150eef09ea7b41ea8cf1de717914a108" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 38317 } } peers { permanent_uuid: "0610621fc8d2439a8df14736f3c35334" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 38089 } }
I20260811 19:01:46.046406 13861 raft_consensus.cc:348] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ae02eb854840a7b5062b47c29b0b6a" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42343 } } peers { permanent_uuid: "150eef09ea7b41ea8cf1de717914a108" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 38317 } } peers { permanent_uuid: "0610621fc8d2439a8df14736f3c35334" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 38089 } }
I20260811 19:01:46.046406 13860 raft_consensus.cc:348] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ae02eb854840a7b5062b47c29b0b6a" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42343 } } peers { permanent_uuid: "150eef09ea7b41ea8cf1de717914a108" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 38317 } } peers { permanent_uuid: "0610621fc8d2439a8df14736f3c35334" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 38089 } }
I20260811 19:01:46.046516 13868 ts_tablet_manager.cc:1428] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 19:01:46.046528 13589 heartbeater.cc:503] Master 127.5.226.126:33917 was elected leader, sending a full tablet report...
I20260811 19:01:46.046562 13860 raft_consensus.cc:374] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:46.046562 13861 raft_consensus.cc:374] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:46.046597 13860 raft_consensus.cc:729] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150eef09ea7b41ea8cf1de717914a108, State: Initialized, Role: FOLLOWER
I20260811 19:01:46.046597 13861 raft_consensus.cc:729] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0610621fc8d2439a8df14736f3c35334, State: Initialized, Role: FOLLOWER
I20260811 19:01:46.046707 13861 consensus_queue.cc:260] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ae02eb854840a7b5062b47c29b0b6a" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42343 } } peers { permanent_uuid: "150eef09ea7b41ea8cf1de717914a108" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 38317 } } peers { permanent_uuid: "0610621fc8d2439a8df14736f3c35334" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 38089 } }
I20260811 19:01:46.046707 13860 consensus_queue.cc:260] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ae02eb854840a7b5062b47c29b0b6a" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42343 } } peers { permanent_uuid: "150eef09ea7b41ea8cf1de717914a108" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 38317 } } peers { permanent_uuid: "0610621fc8d2439a8df14736f3c35334" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 38089 } }
I20260811 19:01:46.046947 13861 ts_tablet_manager.cc:1428] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 19:01:46.046947 13860 ts_tablet_manager.cc:1428] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 19:01:46.047052 13831 heartbeater.cc:503] Master 127.5.226.126:33917 was elected leader, sending a full tablet report...
I20260811 19:01:46.047078 13323 heartbeater.cc:503] Master 127.5.226.126:33917 was elected leader, sending a full tablet report...
W20260811 19:01:46.131426 13590 tablet.cc:2369] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 19:01:46.264856 13324 tablet.cc:2369] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 19:01:46.267062 13834 tablet.cc:2369] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:01:46.392616 13877 raft_consensus.cc:482] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 19:01:46.392759 13877 raft_consensus.cc:504] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ae02eb854840a7b5062b47c29b0b6a" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42343 } } peers { permanent_uuid: "150eef09ea7b41ea8cf1de717914a108" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 38317 } } peers { permanent_uuid: "0610621fc8d2439a8df14736f3c35334" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 38089 } }
I20260811 19:01:46.393129 13877 leader_election.cc:288] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78ae02eb854840a7b5062b47c29b0b6a (127.5.226.66:42343), 150eef09ea7b41ea8cf1de717914a108 (127.5.226.67:38317)
I20260811 19:01:46.395876 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.393383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:33631 (local address 127.5.226.66:42343)
0811 19:01:46.393428 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:46.393430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:46.393553 (+ 123us) server_negotiation.cc:407] Connection header received
0811 19:01:46.393654 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:46.393655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:46.393665 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:46.393708 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:46.393887 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.394348 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.395252 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.395588 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.395650 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:46.395659 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:46.395779 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 19:01:46.395811 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 19:01:46.395910 13881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.393315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.66:42343 (local address 127.5.226.65:33631)
0811 19:01:46.393463 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:46.393473 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:46.393565 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:46.393722 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:46.393723 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:46.393725 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:46.393819 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:46.393821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.394421 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.394422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:46.395170 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:46.395173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.395660 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.395661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:46.395722 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:46.395725 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 19:01:46.395768 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 19:01:46.395806 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":3,"thread_start_us":68,"threads_started":1}
I20260811 19:01:46.395954 13857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.393395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.226.65:50573 (local address 127.5.226.67:38317)
0811 19:01:46.393441 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:46.393443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:46.393580 (+ 137us) server_negotiation.cc:407] Connection header received
0811 19:01:46.393618 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:46.393619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:46.393628 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:46.393686 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 19:01:46.393869 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.394358 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.395282 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.395627 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.395688 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:46.395697 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:46.395849 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 19:01:46.395882 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 19:01:46.396150 13880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.393344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.67:38317 (local address 127.5.226.65:50573)
0811 19:01:46.393473 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:46.393481 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 19:01:46.393557 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:01:46.393719 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:01:46.393720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:01:46.393723 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 19:01:46.393804 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:46.393805 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.394438 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.394438 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:46.395195 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:01:46.395198 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.395714 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.395715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:01:46.395785 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:46.395789 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 19:01:46.395834 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 19:01:46.395870 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":5,"thread_start_us":77,"threads_started":1}
I20260811 19:01:46.396265 13497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba9bbbdc3bf40b59259a6509b730446" candidate_uuid: "0610621fc8d2439a8df14736f3c35334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78ae02eb854840a7b5062b47c29b0b6a" is_pre_election: true
I20260811 19:01:46.396428 13497 raft_consensus.cc:2454] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0610621fc8d2439a8df14736f3c35334 in term 0.
I20260811 19:01:46.396457 13751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba9bbbdc3bf40b59259a6509b730446" candidate_uuid: "0610621fc8d2439a8df14736f3c35334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150eef09ea7b41ea8cf1de717914a108" is_pre_election: true
I20260811 19:01:46.396608 13751 raft_consensus.cc:2454] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0610621fc8d2439a8df14736f3c35334 in term 0.
I20260811 19:01:46.396652 13104 leader_election.cc:302] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0610621fc8d2439a8df14736f3c35334, 78ae02eb854840a7b5062b47c29b0b6a; no voters:
I20260811 19:01:46.396781 13877 raft_consensus.cc:2781] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 19:01:46.396847 13877 raft_consensus.cc:482] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 19:01:46.396863 13877 raft_consensus.cc:3037] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:46.397583 13877 raft_consensus.cc:504] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ae02eb854840a7b5062b47c29b0b6a" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42343 } } peers { permanent_uuid: "150eef09ea7b41ea8cf1de717914a108" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 38317 } } peers { permanent_uuid: "0610621fc8d2439a8df14736f3c35334" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 38089 } }
I20260811 19:01:46.397696 13877 leader_election.cc:288] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [CANDIDATE]: Term 1 election: Requested vote from peers 78ae02eb854840a7b5062b47c29b0b6a (127.5.226.66:42343), 150eef09ea7b41ea8cf1de717914a108 (127.5.226.67:38317)
I20260811 19:01:46.397881 13497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba9bbbdc3bf40b59259a6509b730446" candidate_uuid: "0610621fc8d2439a8df14736f3c35334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78ae02eb854840a7b5062b47c29b0b6a"
I20260811 19:01:46.397913 13751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba9bbbdc3bf40b59259a6509b730446" candidate_uuid: "0610621fc8d2439a8df14736f3c35334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150eef09ea7b41ea8cf1de717914a108"
I20260811 19:01:46.397969 13497 raft_consensus.cc:3037] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:46.397974 13751 raft_consensus.cc:3037] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:46.398836 13751 raft_consensus.cc:2454] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0610621fc8d2439a8df14736f3c35334 in term 1.
I20260811 19:01:46.398845 13497 raft_consensus.cc:2454] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0610621fc8d2439a8df14736f3c35334 in term 1.
I20260811 19:01:46.399016 13104 leader_election.cc:302] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0610621fc8d2439a8df14736f3c35334, 78ae02eb854840a7b5062b47c29b0b6a; no voters:
I20260811 19:01:46.399112 13877 raft_consensus.cc:2781] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:46.399251 13877 raft_consensus.cc:686] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [term 1 LEADER]: Becoming Leader. State: Replica: 0610621fc8d2439a8df14736f3c35334, State: Running, Role: LEADER
I20260811 19:01:46.399346 13877 consensus_queue.cc:237] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ae02eb854840a7b5062b47c29b0b6a" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42343 } } peers { permanent_uuid: "150eef09ea7b41ea8cf1de717914a108" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 38317 } } peers { permanent_uuid: "0610621fc8d2439a8df14736f3c35334" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 38089 } }
I20260811 19:01:46.400151 12980 catalog_manager.cc:5495] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0610621fc8d2439a8df14736f3c35334 (127.5.226.65). New cstate: current_term: 1 leader_uuid: "0610621fc8d2439a8df14736f3c35334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ae02eb854840a7b5062b47c29b0b6a" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150eef09ea7b41ea8cf1de717914a108" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0610621fc8d2439a8df14736f3c35334" member_type: VOTER last_known_addr { host: "127.5.226.65" port: 38089 } health_report { overall_health: HEALTHY } } }
I20260811 19:01:46.477981 13859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.475665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41824 (local address 127.5.226.65:38089)
0811 19:01:46.475723 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:46.475725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:46.475733 (+ 8us) server_negotiation.cc:407] Connection header received
0811 19:01:46.475778 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:46.475779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:46.475800 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:46.475870 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:01:46.476010 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.476480 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.477213 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:46.477458 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:46.477516 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:46.477671 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:01:46.477780 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:01:46.477853 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:46.477880 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 19:01:46.477902 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 19:01:46.479856 13497 raft_consensus.cc:1261] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a [term 1 FOLLOWER]: Refusing update from remote peer 0610621fc8d2439a8df14736f3c35334: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:01:46.479857 13751 raft_consensus.cc:1261] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108 [term 1 FOLLOWER]: Refusing update from remote peer 0610621fc8d2439a8df14736f3c35334: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:01:46.480193 13877 consensus_queue.cc:1035] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "150eef09ea7b41ea8cf1de717914a108" member_type: VOTER last_known_addr { host: "127.5.226.67" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:01:46.480356 13882 consensus_queue.cc:1035] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78ae02eb854840a7b5062b47c29b0b6a" member_type: VOTER last_known_addr { host: "127.5.226.66" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:01:46.485512 12980 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:01:46.485616 12980 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 19:01:46.486347 12980 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6cf6fc616ee0420d90685bf262b69a29: Sending DeleteTablet for 3 replicas of tablet 1ba9bbbdc3bf40b59259a6509b730446
I20260811 19:01:46.486689 13451 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ba9bbbdc3bf40b59259a6509b730446 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:46 UTC) from {username='slave'} at 127.0.0.1:52314
I20260811 19:01:46.486719 13720 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ba9bbbdc3bf40b59259a6509b730446 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:46 UTC) from {username='slave'} at 127.0.0.1:45192
I20260811 19:01:46.486717 13202 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ba9bbbdc3bf40b59259a6509b730446 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 19:01:46 UTC) from {username='slave'} at 127.0.0.1:41818
I20260811 19:01:46.486939 13919 tablet_replica.cc:330] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334: stopping tablet replica
I20260811 19:01:46.487040 13919 raft_consensus.cc:2229] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [term 1 LEADER]: Raft consensus shutting down.
I20260811 19:01:46.487164 13919 raft_consensus.cc:2258] T 1ba9bbbdc3bf40b59259a6509b730446 P 0610621fc8d2439a8df14736f3c35334 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:46.487203 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 13077
I20260811 19:01:46.493467 13917 tablet_replica.cc:330] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a: stopping tablet replica
I20260811 19:01:46.493649 13917 raft_consensus.cc:2229] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:01:46.493809 13917 raft_consensus.cc:2258] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:46.496635 13916 tablet_replica.cc:330] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108: stopping tablet replica
I20260811 19:01:46.496726 13917 ts_tablet_manager.cc:1905] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:46.496778 13916 raft_consensus.cc:2229] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 19:01:46.496902 13916 raft_consensus.cc:2258] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 19:01:46.497395 13916 ts_tablet_manager.cc:1905] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 19:01:46.498421 13917 ts_tablet_manager.cc:1918] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:46.498497 13917 log.cc:1196] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-1/wal/wals/1ba9bbbdc3bf40b59259a6509b730446
I20260811 19:01:46.498757 13917 ts_tablet_manager.cc:1939] T 1ba9bbbdc3bf40b59259a6509b730446 P 78ae02eb854840a7b5062b47c29b0b6a: Deleting consensus metadata
I20260811 19:01:46.498950 13916 ts_tablet_manager.cc:1918] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 19:01:46.499029 13916 log.cc:1196] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108: Deleting WAL directory at /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474660766540-6025-0/minicluster-data/ts-2/wal/wals/1ba9bbbdc3bf40b59259a6509b730446
I20260811 19:01:46.499194 12944 catalog_manager.cc:4841] TS 78ae02eb854840a7b5062b47c29b0b6a (127.5.226.66:42343): tablet 1ba9bbbdc3bf40b59259a6509b730446 (table test-table [id=610ca7cd656341f78aa5c460ab58766f]) successfully deleted
I20260811 19:01:46.499310 13916 ts_tablet_manager.cc:1939] T 1ba9bbbdc3bf40b59259a6509b730446 P 150eef09ea7b41ea8cf1de717914a108: Deleting consensus metadata
I20260811 19:01:46.499737 12945 catalog_manager.cc:4841] TS 150eef09ea7b41ea8cf1de717914a108 (127.5.226.67:38317): tablet 1ba9bbbdc3bf40b59259a6509b730446 (table test-table [id=610ca7cd656341f78aa5c460ab58766f]) successfully deleted
W20260811 19:01:46.501423 12947 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.226.65:38089 (error 108)
I20260811 19:01:46.501889 13854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:46.501776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.65:38089 (local address 127.0.0.1:41826)
0811 19:01:46.501822 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 19:01:46.501861 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.65:38089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 19:01:46.501953 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 13327
W20260811 19:01:46.502017 12947 catalog_manager.cc:4584] TS 0610621fc8d2439a8df14736f3c35334 (127.5.226.65:38089): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1ba9bbbdc3bf40b59259a6509b730446: Network error: Client connection negotiation failed: client connection to 127.5.226.65:38089: connect: Connection refused (error 111)
I20260811 19:01:46.513856 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 13597
I20260811 19:01:46.525107 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 12913
2026-08-11T19:01:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1087 ms)
[----------] 6 tests from EncryptionPolicyTest (9566 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:01:46 dist-test-slave-gjw7 krb5kdc[13935](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:01:46 dist-test-slave-gjw7 krb5kdc[13935](info): set up 2 sockets
Aug 11 19:01:46 dist-test-slave-gjw7 krb5kdc[13935](info): commencing operation
krb5kdc: starting...
W20260811 19:01:47.740883 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:01:47 dist-test-slave-gjw7 krb5kdc[13935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474907, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:01:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 19:01:47.859285 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40501
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40501
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:47.942971 13968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:47.943181 13968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:47.943212 13968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:47.944322 13968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:47.944370 13968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:47.944391 13968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:47.944406 13968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:47.944422 13968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:47.945938 13968 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40501
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:47.946187 13968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:47.946393 13968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:47.950956 13975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:47.950964 13976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:47.950964 13981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:47.951084 13968 server_base.cc:1034] running on GCE node
I20260811 19:01:47.951404 13968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:47.951694 13968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:47.952839 13968 hybrid_clock.cc:648] HybridClock initialized: now 1786474907952813 us; error 36 us; skew 500 ppm
Aug 11 19:01:47 dist-test-slave-gjw7 krb5kdc[13935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474907, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:47.955209 13968 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 19:01:47.955610 13968 webserver.cc:460] Webserver started at http://127.0.0.1:38541/ using document root <none> and password file <none>
I20260811 19:01:47.955813 13968 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:47.955862 13968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:47.956005 13968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:47.957022 13968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "3fb460524c8548708ad87ee66d2e93e0"
format_stamp: "Formatted at 2026-08-11 19:01:47 on dist-test-slave-gjw7"
server_key: "8d922b476e1480190364a40e0c50b205"
server_key_iv: "83801c67948399edc9e3903dca3a4a0a"
server_key_version: "encryptionkey@0"
I20260811 19:01:47.957412 13968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "3fb460524c8548708ad87ee66d2e93e0"
format_stamp: "Formatted at 2026-08-11 19:01:47 on dist-test-slave-gjw7"
server_key: "8d922b476e1480190364a40e0c50b205"
server_key_iv: "83801c67948399edc9e3903dca3a4a0a"
server_key_version: "encryptionkey@0"
I20260811 19:01:47.958642 13968 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:01:47.959277 13991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:47.959434 13968 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:47.959520 13968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "3fb460524c8548708ad87ee66d2e93e0"
format_stamp: "Formatted at 2026-08-11 19:01:47 on dist-test-slave-gjw7"
server_key: "8d922b476e1480190364a40e0c50b205"
server_key_iv: "83801c67948399edc9e3903dca3a4a0a"
server_key_version: "encryptionkey@0"
I20260811 19:01:47.959586 13968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:47.975575 13968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:47.977370 13968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:47.977509 13968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:47.981310 13968 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40501
I20260811 19:01:47.981369 14099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40501 every 8 connection(s)
I20260811 19:01:47.981706 13968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:47.982672 14100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:47.983697 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 13968
I20260811 19:01:47.983807 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:47.984017 6025 external_mini_cluster.cc:1428] Setting key a7b8016d443eaa33294e8e24267a982f
I20260811 19:01:47.985425 14100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0: Bootstrap starting.
I20260811 19:01:47.986037 14100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:47.986374 14100 log.cc:824] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:47.987102 14100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0: No bootstrap required, opened a new log
I20260811 19:01:47.989271 14100 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb460524c8548708ad87ee66d2e93e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40501 } }
I20260811 19:01:47.989468 14100 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:47.989495 14100 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fb460524c8548708ad87ee66d2e93e0, State: Initialized, Role: FOLLOWER
I20260811 19:01:47.989622 14100 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb460524c8548708ad87ee66d2e93e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40501 } }
I20260811 19:01:47.989696 14100 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:47.989720 14100 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:47.989765 14100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:47.990310 14100 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb460524c8548708ad87ee66d2e93e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40501 } }
I20260811 19:01:47.990432 14100 leader_election.cc:302] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3fb460524c8548708ad87ee66d2e93e0; no voters:
I20260811 19:01:47.990597 14100 leader_election.cc:288] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:47.990628 14108 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:47.990803 14108 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [term 1 LEADER]: Becoming Leader. State: Replica: 3fb460524c8548708ad87ee66d2e93e0, State: Running, Role: LEADER
Aug 11 19:01:47 dist-test-slave-gjw7 krb5kdc[13935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474907, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 19:01:47.990854 14100 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:47.991480 14108 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb460524c8548708ad87ee66d2e93e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40501 } }
I20260811 19:01:47.992066 14112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3fb460524c8548708ad87ee66d2e93e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb460524c8548708ad87ee66d2e93e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40501 } } }
I20260811 19:01:47.992048 14111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3fb460524c8548708ad87ee66d2e93e0. Latest consensus state: current_term: 1 leader_uuid: "3fb460524c8548708ad87ee66d2e93e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb460524c8548708ad87ee66d2e93e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40501 } } }
I20260811 19:01:47.992156 14112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:47.992162 14111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0 [sys.catalog]: This master's current role is: LEADER
W20260811 19:01:47.993180 14132 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:01:47.993239 14132 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:01:47.993281 14134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:47.993475 14134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:47.995085 14104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:47.984519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34285 (local address 127.0.0.1:40501)
0811 19:01:47.984712 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:47.984721 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:47.984756 (+ 35us) server_negotiation.cc:407] Connection header received
0811 19:01:47.985261 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:47.985271 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:47.985360 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:47.985514 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:47.986107 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:47.987391 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:47.988126 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:47.988741 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:47.988860 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:47.991460 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:47.991464 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:47.991464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:47.991478 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:47.993332 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:47.993696 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:47.993699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:47.993699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:47.993789 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:47.993995 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:47.993995 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:47.993996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:47.994296 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:47.994449 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:47.994862 (+ 413us) server_negotiation.cc:299] Negotiation successful
0811 19:01:47.994941 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":89,"threads_started":1}
I20260811 19:01:47.995187 14134 catalog_manager.cc:1347] Generated new cluster ID: e9bdd683daef4296a36ce36346f2a6b6
I20260811 19:01:47.995231 14134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:47.995994 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:01:48.005390 14134 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:48.006085 14134 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:48.007473 14104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:48.001599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50823 (local address 127.0.0.1:40501)
0811 19:01:48.001636 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:48.001637 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:48.001746 (+ 109us) server_negotiation.cc:407] Connection header received
0811 19:01:48.001800 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:48.001801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:48.001811 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:48.001869 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:48.002371 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:48.002868 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:48.003547 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:48.003750 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:48.003805 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:48.004869 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:48.004871 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:48.004871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:48.004879 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:48.006409 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:48.006745 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:48.006746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:48.006746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:48.006798 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:48.006988 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:48.006989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:48.006989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:48.007092 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:48.007183 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:48.007298 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 19:01:48.007369 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 19:01:48.015507 14134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3fb460524c8548708ad87ee66d2e93e0: Generated new TSK 0
I20260811 19:01:48.015708 14134 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:01:48.018361 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 13968
W20260811 19:01:48.034401 13931 connection.cc:535] client connection to 127.0.0.1:40501 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40501): Connection reset by peer (error 104)
2026-08-11T19:01:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1491 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:01:48 dist-test-slave-gjw7 krb5kdc[14152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:01:48 dist-test-slave-gjw7 krb5kdc[14152](info): set up 2 sockets
Aug 11 19:01:48 dist-test-slave-gjw7 krb5kdc[14152](info): commencing operation
krb5kdc: starting...
W20260811 19:01:49.230684 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:01:49 dist-test-slave-gjw7 krb5kdc[14152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:01:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 19:01:49.345767 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39265
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:49.427739 14178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:49.427963 14178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:49.427994 14178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:49.429113 14178 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:49.429154 14178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:49.429172 14178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:49.429189 14178 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:49.429203 14178 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:49.430768 14178 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39265
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14178
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:49.431026 14178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:49.431231 14178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:49.435783 14187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:49.435783 14191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:49.435833 14188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:49.435999 14178 server_base.cc:1034] running on GCE node
I20260811 19:01:49.436228 14178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:49.436496 14178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:49.437628 14178 hybrid_clock.cc:648] HybridClock initialized: now 1786474909437612 us; error 33 us; skew 500 ppm
Aug 11 19:01:49 dist-test-slave-gjw7 krb5kdc[14152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474909, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:49.439895 14178 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 19:01:49.440303 14178 webserver.cc:460] Webserver started at http://127.0.0.1:40043/ using document root <none> and password file <none>
I20260811 19:01:49.440500 14178 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:49.440544 14178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:49.440670 14178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:49.441726 14178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "10011eb5fa7a456db219014eb52bf834"
format_stamp: "Formatted at 2026-08-11 19:01:49 on dist-test-slave-gjw7"
server_key: "c306a62b1b0ea41528df88b122e4da62"
server_key_iv: "80a357c6c8ee0ea26e376b31859a5ce6"
server_key_version: "encryptionkey@0"
I20260811 19:01:49.442049 14178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "10011eb5fa7a456db219014eb52bf834"
format_stamp: "Formatted at 2026-08-11 19:01:49 on dist-test-slave-gjw7"
server_key: "c306a62b1b0ea41528df88b122e4da62"
server_key_iv: "80a357c6c8ee0ea26e376b31859a5ce6"
server_key_version: "encryptionkey@0"
I20260811 19:01:49.443249 14178 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:01:49.443899 14208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:49.444041 14178 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:49.444121 14178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "10011eb5fa7a456db219014eb52bf834"
format_stamp: "Formatted at 2026-08-11 19:01:49 on dist-test-slave-gjw7"
server_key: "c306a62b1b0ea41528df88b122e4da62"
server_key_iv: "80a357c6c8ee0ea26e376b31859a5ce6"
server_key_version: "encryptionkey@0"
I20260811 19:01:49.444182 14178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:49.450660 14178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:49.452204 14178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:49.452338 14178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:49.456084 14178 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39265
I20260811 19:01:49.456116 14299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39265 every 8 connection(s)
I20260811 19:01:49.456413 14178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:49.457355 14300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:49.459537 14300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834: Bootstrap starting.
I20260811 19:01:49.460047 14300 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:49.460274 14300 log.cc:824] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:49.460426 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 14178
I20260811 19:01:49.460556 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:49.460772 6025 external_mini_cluster.cc:1428] Setting key e92c8c0131248e3f02f5a29b08cef048
I20260811 19:01:49.460989 14300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834: No bootstrap required, opened a new log
I20260811 19:01:49.462834 14300 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10011eb5fa7a456db219014eb52bf834" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } }
I20260811 19:01:49.462970 14300 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:49.463004 14300 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10011eb5fa7a456db219014eb52bf834, State: Initialized, Role: FOLLOWER
I20260811 19:01:49.463127 14300 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10011eb5fa7a456db219014eb52bf834" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } }
I20260811 19:01:49.463201 14300 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:49.463234 14300 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:49.463281 14300 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:49.463784 14300 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10011eb5fa7a456db219014eb52bf834" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } }
I20260811 19:01:49.463882 14300 leader_election.cc:302] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10011eb5fa7a456db219014eb52bf834; no voters:
I20260811 19:01:49.464041 14300 leader_election.cc:288] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:49.464074 14310 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:49.464178 14310 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [term 1 LEADER]: Becoming Leader. State: Replica: 10011eb5fa7a456db219014eb52bf834, State: Running, Role: LEADER
I20260811 19:01:49.464303 14300 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:49.464310 14310 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10011eb5fa7a456db219014eb52bf834" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } }
I20260811 19:01:49.464694 14310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10011eb5fa7a456db219014eb52bf834. Latest consensus state: current_term: 1 leader_uuid: "10011eb5fa7a456db219014eb52bf834" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10011eb5fa7a456db219014eb52bf834" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } } }
I20260811 19:01:49.464936 14310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:49.464865 14311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10011eb5fa7a456db219014eb52bf834" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10011eb5fa7a456db219014eb52bf834" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } } }
I20260811 19:01:49.465387 14311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:49.465477 14322 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:49.466097 14322 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:49.467007 14307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:49.461231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35713 (local address 127.0.0.1:39265)
0811 19:01:49.461446 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:49.461454 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:49.461479 (+ 25us) server_negotiation.cc:407] Connection header received
0811 19:01:49.462185 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:49.462192 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:49.462238 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:49.462356 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:49.462579 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:49.463787 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:49.464783 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:49.465374 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:49.465461 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:49.466424 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:49.466429 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:49.466429 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:49.466595 (+ 166us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:49.466625 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:49.466636 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:49.466708 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:49.466805 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 19:01:49.466842 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":106,"threads_started":1}
I20260811 19:01:49.467746 14322 catalog_manager.cc:1347] Generated new cluster ID: f3f44f43d6f84d3e8cebcbe37b7bfb60
I20260811 19:01:49.467797 14322 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:49.468052 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:01:49.472843 14322 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:49.473465 14322 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:49.476944 14307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:49.473133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49737 (local address 127.0.0.1:39265)
0811 19:01:49.473170 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:49.473172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:49.473355 (+ 183us) server_negotiation.cc:407] Connection header received
0811 19:01:49.473474 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:49.473475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:49.473485 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:49.473513 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:49.473707 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:49.474450 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:49.475543 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:49.475857 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:49.475913 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:49.476680 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:49.476682 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:49.476682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:49.476687 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:49.476701 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:49.476705 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:49.476736 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:49.476859 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 19:01:49.476870 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 19:01:49.487874 14322 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10011eb5fa7a456db219014eb52bf834: Generated new TSK 0
I20260811 19:01:49.488040 14322 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:01:49.490568 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 14178
W20260811 19:01:49.509698 14150 connection.cc:535] client connection to 127.0.0.1:39265 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39265): Connection reset by peer (error 104)
2026-08-11T19:01:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1475 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:01:49 dist-test-slave-gjw7 krb5kdc[14356](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:01:49 dist-test-slave-gjw7 krb5kdc[14356](info): set up 2 sockets
Aug 11 19:01:49 dist-test-slave-gjw7 krb5kdc[14356](info): commencing operation
krb5kdc: starting...
W20260811 19:01:50.701424 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:01:50 dist-test-slave-gjw7 krb5kdc[14356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:01:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 19:01:50.819857 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40425
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40425
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:50.901193 14377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:50.901412 14377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:50.901444 14377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:50.902578 14377 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:50.902637 14377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:50.902657 14377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:50.902674 14377 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:50.902694 14377 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:50.904171 14377 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40425
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:50.904419 14377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:50.904624 14377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:50.909106 14386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:50.909135 14384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:50.909229 14383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:50.909230 14377 server_base.cc:1034] running on GCE node
I20260811 19:01:50.909600 14377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:50.909883 14377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:50.911024 14377 hybrid_clock.cc:648] HybridClock initialized: now 1786474910911008 us; error 34 us; skew 500 ppm
Aug 11 19:01:50 dist-test-slave-gjw7 krb5kdc[14356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474910, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:50.917520 14377 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 19:01:50.917939 14377 webserver.cc:460] Webserver started at http://127.0.0.1:39213/ using document root <none> and password file <none>
I20260811 19:01:50.918139 14377 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:50.918179 14377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:50.918270 14377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:50.919296 14377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "72befd6c102a47acb856b3cf7c665b38"
format_stamp: "Formatted at 2026-08-11 19:01:50 on dist-test-slave-gjw7"
server_key: "7868c4353cb028a2c5c8b13e66c4bef8"
server_key_iv: "1bab7b0418ceb8a094d75a70fc3eaf44"
server_key_version: "encryptionkey@0"
I20260811 19:01:50.919613 14377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "72befd6c102a47acb856b3cf7c665b38"
format_stamp: "Formatted at 2026-08-11 19:01:50 on dist-test-slave-gjw7"
server_key: "7868c4353cb028a2c5c8b13e66c4bef8"
server_key_iv: "1bab7b0418ceb8a094d75a70fc3eaf44"
server_key_version: "encryptionkey@0"
I20260811 19:01:50.920810 14377 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 19:01:50.921492 14415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:50.921634 14377 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:50.921708 14377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "72befd6c102a47acb856b3cf7c665b38"
format_stamp: "Formatted at 2026-08-11 19:01:50 on dist-test-slave-gjw7"
server_key: "7868c4353cb028a2c5c8b13e66c4bef8"
server_key_iv: "1bab7b0418ceb8a094d75a70fc3eaf44"
server_key_version: "encryptionkey@0"
I20260811 19:01:50.921777 14377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:50.925079 14377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:50.926785 14377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:50.926903 14377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:50.930759 14377 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40425
I20260811 19:01:50.930790 14521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40425 every 8 connection(s)
I20260811 19:01:50.931073 14377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:50.931979 14522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:50.934293 14522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38: Bootstrap starting.
I20260811 19:01:50.934652 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 14377
I20260811 19:01:50.934777 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:50.934940 14522 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:50.934986 6025 external_mini_cluster.cc:1428] Setting key 5242ee1f169a0288efe29b144cee94d2
I20260811 19:01:50.935249 14522 log.cc:824] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:50.935911 14522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38: No bootstrap required, opened a new log
I20260811 19:01:50.937431 14527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:50.935548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43827 (local address 127.0.0.1:40425)
0811 19:01:50.935715 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:50.935722 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:50.935744 (+ 22us) server_negotiation.cc:407] Connection header received
0811 19:01:50.936218 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:50.936226 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:50.936254 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:50.936375 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:50.937013 (+ 638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:50.937017 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:50.937017 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:50.937021 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:50.937063 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:50.937072 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:50.937146 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:50.937195 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 19:01:50.937234 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":68,"threads_started":1}
I20260811 19:01:50.938094 14522 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72befd6c102a47acb856b3cf7c665b38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40425 } }
I20260811 19:01:50.938257 14522 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:50.938304 14522 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72befd6c102a47acb856b3cf7c665b38, State: Initialized, Role: FOLLOWER
I20260811 19:01:50.938321 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:01:50.938421 14522 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72befd6c102a47acb856b3cf7c665b38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40425 } }
I20260811 19:01:50.938505 14522 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:50.938531 14522 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:50.938565 14522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:50.939184 14522 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72befd6c102a47acb856b3cf7c665b38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40425 } }
I20260811 19:01:50.939280 14522 leader_election.cc:302] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72befd6c102a47acb856b3cf7c665b38; no voters:
I20260811 19:01:50.939438 14522 leader_election.cc:288] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:50.939474 14534 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:50.939620 14534 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [term 1 LEADER]: Becoming Leader. State: Replica: 72befd6c102a47acb856b3cf7c665b38, State: Running, Role: LEADER
I20260811 19:01:50.939666 14522 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:50.939971 14534 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72befd6c102a47acb856b3cf7c665b38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40425 } }
I20260811 19:01:50.940352 14541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72befd6c102a47acb856b3cf7c665b38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72befd6c102a47acb856b3cf7c665b38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40425 } } }
I20260811 19:01:50.940440 14541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:50.940618 14541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72befd6c102a47acb856b3cf7c665b38. Latest consensus state: current_term: 1 leader_uuid: "72befd6c102a47acb856b3cf7c665b38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72befd6c102a47acb856b3cf7c665b38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40425 } } }
I20260811 19:01:50.940704 14541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:50.940770 14564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:50.941192 14527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:50.939822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59875 (local address 127.0.0.1:40425)
0811 19:01:50.939853 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:50.939854 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:50.940033 (+ 179us) server_negotiation.cc:407] Connection header received
0811 19:01:50.940130 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:50.940131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:50.940137 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:50.940192 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:50.940967 (+ 775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:50.940968 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:50.940968 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:50.940973 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:50.940986 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:50.940989 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:50.941033 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:50.941124 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 19:01:50.941139 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 19:01:50.941807 14564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:50.943305 14564 catalog_manager.cc:1347] Generated new cluster ID: 8462307f4a344bfd864bc1ce9c86b503
I20260811 19:01:50.943346 14564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:50.963744 14564 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:50.963927 14564 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:50.966662 14564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72befd6c102a47acb856b3cf7c665b38: Generated new TSK 0
I20260811 19:01:50.966820 14564 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:01:50.973496 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 14377
2026-08-11T19:01:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1487 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:01:51 dist-test-slave-gjw7 krb5kdc[14590](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:01:51 dist-test-slave-gjw7 krb5kdc[14590](info): set up 2 sockets
Aug 11 19:01:51 dist-test-slave-gjw7 krb5kdc[14590](info): commencing operation
krb5kdc: starting...
W20260811 19:01:52.218220 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:01:52 dist-test-slave-gjw7 krb5kdc[14590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:01:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 19:01:52.336210 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38717
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38717
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:52.418395 14620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:52.418610 14620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:52.418634 14620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:52.419785 14620 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:52.419832 14620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:52.419848 14620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:52.419875 14620 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:52.419903 14620 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:52.421454 14620 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:52.421705 14620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:52.421924 14620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:52.426563 14633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:52.426584 14637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:52.426640 14620 server_base.cc:1034] running on GCE node
W20260811 19:01:52.426563 14634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:52.427043 14620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:52.427299 14620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:52.428438 14620 hybrid_clock.cc:648] HybridClock initialized: now 1786474912428419 us; error 34 us; skew 500 ppm
Aug 11 19:01:52 dist-test-slave-gjw7 krb5kdc[14590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474912, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:52.430773 14620 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 19:01:52.431166 14620 webserver.cc:460] Webserver started at http://127.0.0.1:35235/ using document root <none> and password file <none>
I20260811 19:01:52.431370 14620 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:52.431416 14620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:52.431533 14620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:52.432523 14620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "257052ab10884bfe8caede6905cba122"
format_stamp: "Formatted at 2026-08-11 19:01:52 on dist-test-slave-gjw7"
server_key: "a5b3c9e8673bef7647dcc9255a871c69"
server_key_iv: "92053072f2bf73e042d6df5637cd6cef"
server_key_version: "encryptionkey@0"
I20260811 19:01:52.432840 14620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "257052ab10884bfe8caede6905cba122"
format_stamp: "Formatted at 2026-08-11 19:01:52 on dist-test-slave-gjw7"
server_key: "a5b3c9e8673bef7647dcc9255a871c69"
server_key_iv: "92053072f2bf73e042d6df5637cd6cef"
server_key_version: "encryptionkey@0"
I20260811 19:01:52.434103 14620 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 19:01:52.434741 14647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:52.434875 14620 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:52.434955 14620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "257052ab10884bfe8caede6905cba122"
format_stamp: "Formatted at 2026-08-11 19:01:52 on dist-test-slave-gjw7"
server_key: "a5b3c9e8673bef7647dcc9255a871c69"
server_key_iv: "92053072f2bf73e042d6df5637cd6cef"
server_key_version: "encryptionkey@0"
I20260811 19:01:52.435019 14620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:52.450601 14620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:52.452301 14620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:52.452435 14620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:52.456375 14620 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38717
I20260811 19:01:52.456406 14765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38717 every 8 connection(s)
I20260811 19:01:52.456713 14620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:52.457628 14767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:52.459821 14767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122: Bootstrap starting.
I20260811 19:01:52.460390 14767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:52.460645 14767 log.cc:824] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:52.461210 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 14620
I20260811 19:01:52.461326 14767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122: No bootstrap required, opened a new log
I20260811 19:01:52.461338 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:52.461509 6025 external_mini_cluster.cc:1428] Setting key 8f99e3c24d11c55c6df6e30f70ad3643
I20260811 19:01:52.463527 14767 raft_consensus.cc:348] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "257052ab10884bfe8caede6905cba122" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38717 } }
I20260811 19:01:52.463663 14767 raft_consensus.cc:374] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:52.463697 14767 raft_consensus.cc:729] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257052ab10884bfe8caede6905cba122, State: Initialized, Role: FOLLOWER
I20260811 19:01:52.463820 14767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "257052ab10884bfe8caede6905cba122" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38717 } }
I20260811 19:01:52.463901 14767 raft_consensus.cc:388] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:52.463933 14767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:52.463979 14767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:52.464494 14767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "257052ab10884bfe8caede6905cba122" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38717 } }
I20260811 19:01:52.464589 14767 leader_election.cc:302] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 257052ab10884bfe8caede6905cba122; no voters:
I20260811 19:01:52.464742 14767 leader_election.cc:288] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:52.464783 14773 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:52.464900 14773 raft_consensus.cc:686] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [term 1 LEADER]: Becoming Leader. State: Replica: 257052ab10884bfe8caede6905cba122, State: Running, Role: LEADER
I20260811 19:01:52.465039 14767 sys_catalog.cc:564] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:52.465036 14773 consensus_queue.cc:237] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "257052ab10884bfe8caede6905cba122" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38717 } }
I20260811 19:01:52.465950 14777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 257052ab10884bfe8caede6905cba122. Latest consensus state: current_term: 1 leader_uuid: "257052ab10884bfe8caede6905cba122" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "257052ab10884bfe8caede6905cba122" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38717 } } }
I20260811 19:01:52.466087 14777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:52.466133 14774 sys_catalog.cc:455] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "257052ab10884bfe8caede6905cba122" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "257052ab10884bfe8caede6905cba122" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38717 } } }
I20260811 19:01:52.466213 14774 sys_catalog.cc:458] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122 [sys.catalog]: This master's current role is: LEADER
W20260811 19:01:52.466970 14816 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:01:52.467064 14816 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:01:52.467159 14815 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:52.467386 14815 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 19:01:52 dist-test-slave-gjw7 krb5kdc[14590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 19:01:52.469213 14815 catalog_manager.cc:1347] Generated new cluster ID: 82b71ada81bc4197b17ff189073d8208
I20260811 19:01:52.469262 14815 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:52.472008 14772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:52.461982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52659 (local address 127.0.0.1:38717)
0811 19:01:52.462143 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:52.462151 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:52.462176 (+ 25us) server_negotiation.cc:407] Connection header received
0811 19:01:52.462608 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:52.462616 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:52.462662 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:52.462773 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:52.463495 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:52.464695 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:52.465609 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:52.466182 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:52.466288 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:52.468984 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:52.468988 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:52.468988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:52.469001 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:52.470541 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:52.470861 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:52.470864 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:52.470865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:52.470948 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:52.471114 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:52.471114 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:52.471115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:52.471337 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:52.471482 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:52.471591 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 19:01:52.471723 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":73,"threads_started":1}
I20260811 19:01:52.472839 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:01:52.482806 14772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:52.474112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50803 (local address 127.0.0.1:38717)
0811 19:01:52.474147 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:52.474149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:52.477512 (+ 3363us) server_negotiation.cc:407] Connection header received
0811 19:01:52.477570 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:52.477571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:52.477581 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:52.477626 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:52.478107 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:52.478579 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:52.479250 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:52.479489 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:52.479542 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:52.480559 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:52.480560 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:52.480560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:52.480567 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:52.481823 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:52.482146 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:52.482147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:52.482147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:52.482199 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:52.482363 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:52.482364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:52.482364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:52.482465 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:52.482548 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:52.482648 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 19:01:52.482723 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 19:01:52.483343 14815 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:52.484006 14815 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:52.488960 14815 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 257052ab10884bfe8caede6905cba122: Generated new TSK 0
I20260811 19:01:52.489130 14815 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:01:52.495738 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 14620
2026-08-11T19:01:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1520 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:01:52 dist-test-slave-gjw7 krb5kdc[14834](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:01:52 dist-test-slave-gjw7 krb5kdc[14834](info): set up 2 sockets
Aug 11 19:01:52 dist-test-slave-gjw7 krb5kdc[14834](info): commencing operation
krb5kdc: starting...
W20260811 19:01:53.717540 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:01:53 dist-test-slave-gjw7 krb5kdc[14834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:01:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 19:01:53.837620 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43671
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:53.920954 14869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:53.921159 14869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:53.921181 14869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:53.922283 14869 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:53.922322 14869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:53.922334 14869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:53.922345 14869 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:53.922355 14869 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:53.923787 14869 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:53.923985 14869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:53.924161 14869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 19:01:53.928879 14869 server_base.cc:1034] running on GCE node
W20260811 19:01:53.928977 14886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:53.928951 14892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:53.929006 14889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:53.929380 14869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:53.929656 14869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:53.930788 14869 hybrid_clock.cc:648] HybridClock initialized: now 1786474913930775 us; error 29 us; skew 500 ppm
Aug 11 19:01:53 dist-test-slave-gjw7 krb5kdc[14834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474913, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:53.933195 14869 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 19:01:53.933612 14869 webserver.cc:460] Webserver started at http://127.0.0.1:42743/ using document root <none> and password file <none>
I20260811 19:01:53.933800 14869 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:53.933842 14869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:53.934016 14869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:53.935077 14869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "64ba72284b644663be4ee3b3b5d3ec8a"
format_stamp: "Formatted at 2026-08-11 19:01:53 on dist-test-slave-gjw7"
server_key: "2dc283313f305150bdc8c1202efa9dcd"
server_key_iv: "98ca91ed69ad0ef48285bd7e7abff8a4"
server_key_version: "encryptionkey@0"
I20260811 19:01:53.935402 14869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "64ba72284b644663be4ee3b3b5d3ec8a"
format_stamp: "Formatted at 2026-08-11 19:01:53 on dist-test-slave-gjw7"
server_key: "2dc283313f305150bdc8c1202efa9dcd"
server_key_iv: "98ca91ed69ad0ef48285bd7e7abff8a4"
server_key_version: "encryptionkey@0"
I20260811 19:01:53.936619 14869 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 19:01:53.937254 14906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:53.937412 14869 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:53.937503 14869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "64ba72284b644663be4ee3b3b5d3ec8a"
format_stamp: "Formatted at 2026-08-11 19:01:53 on dist-test-slave-gjw7"
server_key: "2dc283313f305150bdc8c1202efa9dcd"
server_key_iv: "98ca91ed69ad0ef48285bd7e7abff8a4"
server_key_version: "encryptionkey@0"
I20260811 19:01:53.937559 14869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:53.952020 14869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:53.953926 14869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:53.954068 14869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:53.958307 14869 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43671
I20260811 19:01:53.958355 15017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43671 every 8 connection(s)
I20260811 19:01:53.958690 14869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:53.959599 15021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:53.961887 15021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a: Bootstrap starting.
I20260811 19:01:53.962436 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 14869
I20260811 19:01:53.962517 15021 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:53.962553 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:53.962770 6025 external_mini_cluster.cc:1428] Setting key 07e8a91b151a7b7a97e2eb0a04d0b7e7
I20260811 19:01:53.962841 15021 log.cc:824] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:53.963578 15021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a: No bootstrap required, opened a new log
I20260811 19:01:53.965150 15021 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ba72284b644663be4ee3b3b5d3ec8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43671 } }
I20260811 19:01:53.965314 15021 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:53.965364 15021 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64ba72284b644663be4ee3b3b5d3ec8a, State: Initialized, Role: FOLLOWER
I20260811 19:01:53.965497 15021 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ba72284b644663be4ee3b3b5d3ec8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43671 } }
I20260811 19:01:53.965576 15021 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:53.965608 15021 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:53.965656 15021 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:53.966430 15021 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ba72284b644663be4ee3b3b5d3ec8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43671 } }
I20260811 19:01:53.966528 15021 leader_election.cc:302] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64ba72284b644663be4ee3b3b5d3ec8a; no voters:
I20260811 19:01:53.966694 15021 leader_election.cc:288] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:53.966730 15030 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:53.966838 15030 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [term 1 LEADER]: Becoming Leader. State: Replica: 64ba72284b644663be4ee3b3b5d3ec8a, State: Running, Role: LEADER
I20260811 19:01:53.966967 15021 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:53.966977 15030 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ba72284b644663be4ee3b3b5d3ec8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43671 } }
I20260811 19:01:53.967373 15030 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64ba72284b644663be4ee3b3b5d3ec8a. Latest consensus state: current_term: 1 leader_uuid: "64ba72284b644663be4ee3b3b5d3ec8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ba72284b644663be4ee3b3b5d3ec8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43671 } } }
I20260811 19:01:53.967445 15030 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:53.968425 15031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64ba72284b644663be4ee3b3b5d3ec8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ba72284b644663be4ee3b3b5d3ec8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43671 } } }
I20260811 19:01:53.968585 15031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a [sys.catalog]: This master's current role is: LEADER
W20260811 19:01:53.968871 15063 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:01:53.968967 15063 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:01:53.969064 15046 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:53.969544 15046 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:53.970348 15028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:53.963255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59349 (local address 127.0.0.1:43671)
0811 19:01:53.963420 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:53.963430 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:53.965488 (+ 2058us) server_negotiation.cc:407] Connection header received
0811 19:01:53.965611 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:53.965619 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:53.965678 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:53.965813 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:53.966028 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:53.967120 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:53.968188 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:53.968788 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:53.968907 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:53.969592 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:53.969597 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:53.969597 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:53.969811 (+ 214us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:53.969849 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:53.969874 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:53.969943 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:53.970038 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 19:01:53.970104 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":66,"threads_started":1}
I20260811 19:01:53.971416 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:01:53.971575 15046 catalog_manager.cc:1347] Generated new cluster ID: 37fc91537569400ea00c38bcc0a285b5
I20260811 19:01:53.971630 15046 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:53.975788 15028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:53.972712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37083 (local address 127.0.0.1:43671)
0811 19:01:53.972752 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:53.972754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:53.973428 (+ 674us) server_negotiation.cc:407] Connection header received
0811 19:01:53.973485 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:53.973485 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:53.973497 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:53.973543 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:53.973651 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:53.974097 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:53.974759 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:53.974950 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:53.975003 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:53.975579 (+ 576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:53.975580 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:53.975581 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:53.975585 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:53.975600 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:53.975604 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:53.975648 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:53.975697 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 19:01:53.975720 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 19:01:53.979837 15046 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:53.980348 15046 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:53.983685 15046 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64ba72284b644663be4ee3b3b5d3ec8a: Generated new TSK 0
I20260811 19:01:53.983850 15046 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:01:53.985589 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 14869
2026-08-11T19:01:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1481 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:01:54 dist-test-slave-gjw7 krb5kdc[15079](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:01:54 dist-test-slave-gjw7 krb5kdc[15079](info): set up 2 sockets
Aug 11 19:01:54 dist-test-slave-gjw7 krb5kdc[15079](info): commencing operation
krb5kdc: starting...
W20260811 19:01:55.202078 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:01:55 dist-test-slave-gjw7 krb5kdc[15079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:01:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 19:01:55.317457 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45731
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:55.398458 15101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:55.398659 15101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:55.398690 15101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:55.399825 15101 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:55.399868 15101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:55.399885 15101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:55.399900 15101 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:55.399917 15101 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:55.401378 15101 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:55.401623 15101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:55.401829 15101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:55.406388 15117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:55.406419 15114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:55.406569 15101 server_base.cc:1034] running on GCE node
W20260811 19:01:55.406399 15110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:55.406929 15101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:55.407210 15101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:55.408352 15101 hybrid_clock.cc:648] HybridClock initialized: now 1786474915408336 us; error 27 us; skew 500 ppm
Aug 11 19:01:55 dist-test-slave-gjw7 krb5kdc[15079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474915, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:55.410852 15101 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 19:01:55.411291 15101 webserver.cc:460] Webserver started at http://127.0.0.1:44127/ using document root <none> and password file <none>
I20260811 19:01:55.411484 15101 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:55.411530 15101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:55.411653 15101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:55.412664 15101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "a6a0c8403fe149fba67d434347345b41"
format_stamp: "Formatted at 2026-08-11 19:01:55 on dist-test-slave-gjw7"
server_key: "63a617a51eb077be0c327f9a6d6718a4"
server_key_iv: "cc928192d644808266cb064338dea038"
server_key_version: "encryptionkey@0"
I20260811 19:01:55.413009 15101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "a6a0c8403fe149fba67d434347345b41"
format_stamp: "Formatted at 2026-08-11 19:01:55 on dist-test-slave-gjw7"
server_key: "63a617a51eb077be0c327f9a6d6718a4"
server_key_iv: "cc928192d644808266cb064338dea038"
server_key_version: "encryptionkey@0"
I20260811 19:01:55.414292 15101 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 19:01:55.414958 15131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:55.415112 15101 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:01:55.415199 15101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "a6a0c8403fe149fba67d434347345b41"
format_stamp: "Formatted at 2026-08-11 19:01:55 on dist-test-slave-gjw7"
server_key: "63a617a51eb077be0c327f9a6d6718a4"
server_key_iv: "cc928192d644808266cb064338dea038"
server_key_version: "encryptionkey@0"
I20260811 19:01:55.415271 15101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:55.418545 15101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:55.420229 15101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:55.420359 15101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:55.424216 15101 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45731
I20260811 19:01:55.424243 15249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45731 every 8 connection(s)
I20260811 19:01:55.424540 15101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:55.425486 15253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:55.427649 15253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41: Bootstrap starting.
I20260811 19:01:55.428175 15253 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:55.428431 15253 log.cc:824] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:55.429158 15253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41: No bootstrap required, opened a new log
I20260811 19:01:55.430787 15253 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6a0c8403fe149fba67d434347345b41" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45731 } }
I20260811 19:01:55.430920 15253 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:55.430941 15253 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0c8403fe149fba67d434347345b41, State: Initialized, Role: FOLLOWER
I20260811 19:01:55.431078 15253 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6a0c8403fe149fba67d434347345b41" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45731 } }
I20260811 19:01:55.431157 15253 raft_consensus.cc:388] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:55.431191 15253 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:55.431238 15253 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:55.431702 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 15101
I20260811 19:01:55.431785 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:55.431752 15253 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6a0c8403fe149fba67d434347345b41" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45731 } }
I20260811 19:01:55.431851 15253 leader_election.cc:302] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6a0c8403fe149fba67d434347345b41; no voters:
I20260811 19:01:55.431964 6025 external_mini_cluster.cc:1428] Setting key 498c3d8f349a5d94261855b0474d328e
I20260811 19:01:55.432000 15253 leader_election.cc:288] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:55.432049 15258 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:55.432200 15258 raft_consensus.cc:686] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [term 1 LEADER]: Becoming Leader. State: Replica: a6a0c8403fe149fba67d434347345b41, State: Running, Role: LEADER
I20260811 19:01:55.432298 15253 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:55.432302 15258 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6a0c8403fe149fba67d434347345b41" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45731 } }
I20260811 19:01:55.432744 15262 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6a0c8403fe149fba67d434347345b41. Latest consensus state: current_term: 1 leader_uuid: "a6a0c8403fe149fba67d434347345b41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6a0c8403fe149fba67d434347345b41" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45731 } } }
I20260811 19:01:55.432886 15262 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:55.433090 15269 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:55.432725 15260 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6a0c8403fe149fba67d434347345b41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6a0c8403fe149fba67d434347345b41" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45731 } } }
I20260811 19:01:55.433547 15260 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:55.433709 15269 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:55.434360 15266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:55.432432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59877 (local address 127.0.0.1:45731)
0811 19:01:55.432621 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:55.432629 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:55.432793 (+ 164us) server_negotiation.cc:407] Connection header received
0811 19:01:55.432926 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:55.432934 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:55.432964 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:55.433117 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:55.433808 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:55.433812 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:55.433812 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:55.433817 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:55.433874 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:55.433889 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:55.433951 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:55.434125 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 19:01:55.434174 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":90,"threads_started":1}
I20260811 19:01:55.435340 15269 catalog_manager.cc:1347] Generated new cluster ID: 7bf98fa83f61477d893e1ea148df775f
I20260811 19:01:55.435402 15269 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:55.435446 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:01:55.437745 15266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:55.436728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45029 (local address 127.0.0.1:45731)
0811 19:01:55.436766 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:55.436768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:55.436872 (+ 104us) server_negotiation.cc:407] Connection header received
0811 19:01:55.436934 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:55.436935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:55.436940 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:55.436984 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:55.437537 (+ 553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:55.437538 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:55.437538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:55.437542 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:55.437556 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:55.437560 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:55.437587 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:55.437678 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 19:01:55.437690 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260811 19:01:55.443678 15269 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:55.443814 15269 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:55.455507 15269 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a6a0c8403fe149fba67d434347345b41: Generated new TSK 0
I20260811 19:01:55.455696 15269 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:01:55.464982 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 15101
2026-08-11T19:01:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1473 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:01:55 dist-test-slave-gjw7 krb5kdc[15311](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:01:55 dist-test-slave-gjw7 krb5kdc[15311](info): set up 2 sockets
Aug 11 19:01:55 dist-test-slave-gjw7 krb5kdc[15311](info): commencing operation
krb5kdc: starting...
W20260811 19:01:56.676290 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:01:56 dist-test-slave-gjw7 krb5kdc[15311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:01:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 19:01:56.792028 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46073
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:56.871313 15346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:56.871522 15346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:56.871552 15346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:56.872678 15346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:56.872720 15346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:56.872737 15346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:56.872753 15346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:56.872768 15346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:56.874250 15346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:56.874488 15346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:56.874696 15346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:56.879374 15358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:56.879417 15360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:56.879470 15346 server_base.cc:1034] running on GCE node
W20260811 19:01:56.879397 15363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:56.879849 15346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:56.880124 15346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:56.881260 15346 hybrid_clock.cc:648] HybridClock initialized: now 1786474916881247 us; error 28 us; skew 500 ppm
Aug 11 19:01:56 dist-test-slave-gjw7 krb5kdc[15311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474916, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:56.889848 15346 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 19:01:56.890280 15346 webserver.cc:460] Webserver started at http://127.0.0.1:45943/ using document root <none> and password file <none>
I20260811 19:01:56.890508 15346 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:56.890558 15346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:56.890684 15346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:56.891726 15346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "80efa496dce14f7d8d5a0941a057f191"
format_stamp: "Formatted at 2026-08-11 19:01:56 on dist-test-slave-gjw7"
server_key: "653ca4bf121b0d3992020853dacd934e"
server_key_iv: "736d9d968d0f61fcb344e4976b4d1d08"
server_key_version: "encryptionkey@0"
I20260811 19:01:56.892072 15346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "80efa496dce14f7d8d5a0941a057f191"
format_stamp: "Formatted at 2026-08-11 19:01:56 on dist-test-slave-gjw7"
server_key: "653ca4bf121b0d3992020853dacd934e"
server_key_iv: "736d9d968d0f61fcb344e4976b4d1d08"
server_key_version: "encryptionkey@0"
I20260811 19:01:56.893260 15346 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 19:01:56.893915 15379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:56.894070 15346 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:56.894156 15346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "80efa496dce14f7d8d5a0941a057f191"
format_stamp: "Formatted at 2026-08-11 19:01:56 on dist-test-slave-gjw7"
server_key: "653ca4bf121b0d3992020853dacd934e"
server_key_iv: "736d9d968d0f61fcb344e4976b4d1d08"
server_key_version: "encryptionkey@0"
I20260811 19:01:56.894217 15346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:56.927050 15346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:56.928851 15346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:56.928997 15346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:56.932826 15346 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46073
I20260811 19:01:56.932883 15488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46073 every 8 connection(s)
I20260811 19:01:56.933218 15346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:56.934198 15490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:56.936482 15490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191: Bootstrap starting.
I20260811 19:01:56.936578 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 15346
I20260811 19:01:56.936693 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:56.936869 6025 external_mini_cluster.cc:1428] Setting key 4f168e9538312713b8282279f0e7b964
I20260811 19:01:56.937105 15490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:56.937493 15490 log.cc:824] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:56.938272 15490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191: No bootstrap required, opened a new log
I20260811 19:01:56.940514 15490 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80efa496dce14f7d8d5a0941a057f191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46073 } }
I20260811 19:01:56.940671 15490 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:56.940694 15490 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80efa496dce14f7d8d5a0941a057f191, State: Initialized, Role: FOLLOWER
I20260811 19:01:56.940804 15490 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80efa496dce14f7d8d5a0941a057f191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46073 } }
I20260811 19:01:56.940874 15490 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:56.940897 15490 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:56.940941 15490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:56.941522 15490 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80efa496dce14f7d8d5a0941a057f191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46073 } }
I20260811 19:01:56.941628 15490 leader_election.cc:302] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80efa496dce14f7d8d5a0941a057f191; no voters:
I20260811 19:01:56.941779 15490 leader_election.cc:288] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:56.941823 15501 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:56.941967 15501 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [term 1 LEADER]: Becoming Leader. State: Replica: 80efa496dce14f7d8d5a0941a057f191, State: Running, Role: LEADER
I20260811 19:01:56.942020 15490 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:56.942098 15501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80efa496dce14f7d8d5a0941a057f191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46073 } }
I20260811 19:01:56.942411 15501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80efa496dce14f7d8d5a0941a057f191. Latest consensus state: current_term: 1 leader_uuid: "80efa496dce14f7d8d5a0941a057f191" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80efa496dce14f7d8d5a0941a057f191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46073 } } }
I20260811 19:01:56.942631 15501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:56.942670 15509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80efa496dce14f7d8d5a0941a057f191" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80efa496dce14f7d8d5a0941a057f191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46073 } } }
I20260811 19:01:56.942749 15509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:56.942906 15529 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:56.943424 15529 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 19:01:56 dist-test-slave-gjw7 krb5kdc[15311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 19:01:56.945205 15529 catalog_manager.cc:1347] Generated new cluster ID: 6e7142674aa1446681078e39d9cac1c1
I20260811 19:01:56.945256 15529 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:56.948987 15498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:56.937508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:33561 (local address 127.0.0.1:46073)
0811 19:01:56.937703 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:56.937713 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:56.937750 (+ 37us) server_negotiation.cc:407] Connection header received
0811 19:01:56.938271 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:56.938280 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:56.938346 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:56.938494 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:56.939054 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:56.940446 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:56.941323 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:56.941936 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:56.942389 (+ 453us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:56.944914 (+ 2525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:56.944918 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:56.944918 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:56.944930 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:56.946876 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:56.947331 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:56.947334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:56.947334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:56.947440 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:56.947680 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:56.947681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:56.947681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:56.947992 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:56.948159 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:56.948657 (+ 498us) server_negotiation.cc:299] Negotiation successful
0811 19:01:56.948758 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":91,"threads_started":1}
I20260811 19:01:56.950103 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:01:56.955720 15529 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:56.956204 15529 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:56.965214 15529 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80efa496dce14f7d8d5a0941a057f191: Generated new TSK 0
I20260811 19:01:56.965494 15529 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:01:56.970642 15498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:56.953596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:60193 (local address 127.0.0.1:46073)
0811 19:01:56.953632 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:56.953633 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:56.955481 (+ 1848us) server_negotiation.cc:407] Connection header received
0811 19:01:56.955536 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:56.955537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:56.955548 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:56.955623 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:56.965358 (+ 9735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:56.965941 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:56.966660 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:56.966893 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:56.966952 (+ 59us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:56.968146 (+ 1194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:56.968148 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:56.968149 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:01:56.968157 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:56.969501 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:56.969858 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:56.969859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:56.969860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:56.969928 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:01:56.970127 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:01:56.970127 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:01:56.970128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:01:56.970235 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:56.970333 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:56.970484 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 19:01:56.970548 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 19:01:56.972518 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 15346
W20260811 19:01:56.991964 15308 connection.cc:535] client connection to 127.0.0.1:46073 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46073): Connection reset by peer (error 104)
2026-08-11T19:01:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1519 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:01:57 dist-test-slave-gjw7 krb5kdc[15561](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:01:57 dist-test-slave-gjw7 krb5kdc[15561](info): set up 2 sockets
Aug 11 19:01:57 dist-test-slave-gjw7 krb5kdc[15561](info): commencing operation
krb5kdc: starting...
W20260811 19:01:58.190260 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:01:58 dist-test-slave-gjw7 krb5kdc[15561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:01:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 19:01:58.303747 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41855
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:58.383980 15584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:58.384189 15584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:58.384220 15584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:58.385380 15584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:58.385421 15584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:58.385438 15584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:58.385455 15584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:58.385469 15584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:58.386950 15584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:58.387192 15584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:58.387394 15584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:58.391888 15591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:58.391893 15594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:58.391935 15598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:58.392071 15584 server_base.cc:1034] running on GCE node
I20260811 19:01:58.392306 15584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:58.392596 15584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:58.393728 15584 hybrid_clock.cc:648] HybridClock initialized: now 1786474918393712 us; error 28 us; skew 500 ppm
Aug 11 19:01:58 dist-test-slave-gjw7 krb5kdc[15561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474918, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:58.395974 15584 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 19:01:58.396400 15584 webserver.cc:460] Webserver started at http://127.0.0.1:36789/ using document root <none> and password file <none>
I20260811 19:01:58.396607 15584 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:58.396654 15584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:58.396777 15584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:58.397794 15584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "6749259240264cc288580ca5f731ac78"
format_stamp: "Formatted at 2026-08-11 19:01:58 on dist-test-slave-gjw7"
server_key: "b029f8503ea879b4f156110caa78c936"
server_key_iv: "7724d7dd2301b1972b1eff4941d7aac9"
server_key_version: "encryptionkey@0"
I20260811 19:01:58.398123 15584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "6749259240264cc288580ca5f731ac78"
format_stamp: "Formatted at 2026-08-11 19:01:58 on dist-test-slave-gjw7"
server_key: "b029f8503ea879b4f156110caa78c936"
server_key_iv: "7724d7dd2301b1972b1eff4941d7aac9"
server_key_version: "encryptionkey@0"
I20260811 19:01:58.399294 15584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:01:58.399919 15619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:58.400065 15584 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:01:58.400151 15584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "6749259240264cc288580ca5f731ac78"
format_stamp: "Formatted at 2026-08-11 19:01:58 on dist-test-slave-gjw7"
server_key: "b029f8503ea879b4f156110caa78c936"
server_key_iv: "7724d7dd2301b1972b1eff4941d7aac9"
server_key_version: "encryptionkey@0"
I20260811 19:01:58.400209 15584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:58.410946 15584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:58.412489 15584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:58.412611 15584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:58.416491 15584 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41855
I20260811 19:01:58.416512 15737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41855 every 8 connection(s)
I20260811 19:01:58.416821 15584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:58.417770 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 15584
I20260811 19:01:58.417882 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:58.417874 15739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:58.418074 6025 external_mini_cluster.cc:1428] Setting key 9a03d27a1482539edb7c3b268052e31c
I20260811 19:01:58.421028 15739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78: Bootstrap starting.
I20260811 19:01:58.421640 15739 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:58.421898 15739 log.cc:824] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:58.422515 15739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78: No bootstrap required, opened a new log
I20260811 19:01:58.423511 15745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:58.418558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:57991 (local address 127.0.0.1:41855)
0811 19:01:58.418745 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:58.418755 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:58.418786 (+ 31us) server_negotiation.cc:407] Connection header received
0811 19:01:58.419256 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:58.419265 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:58.419332 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:58.419477 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:58.419622 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:58.420936 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:58.421726 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:58.422152 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:58.422250 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:58.422908 (+ 658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:58.422912 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:58.422912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:58.423061 (+ 149us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:58.423090 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:58.423101 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:58.423167 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:58.423276 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 19:01:58.423302 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":76,"threads_started":1}
I20260811 19:01:58.424481 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:01:58.424494 15739 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6749259240264cc288580ca5f731ac78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41855 } }
I20260811 19:01:58.424649 15739 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:58.424692 15739 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6749259240264cc288580ca5f731ac78, State: Initialized, Role: FOLLOWER
I20260811 19:01:58.424803 15739 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6749259240264cc288580ca5f731ac78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41855 } }
I20260811 19:01:58.424875 15739 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:58.424903 15739 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:58.424948 15739 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:58.425474 15739 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6749259240264cc288580ca5f731ac78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41855 } }
I20260811 19:01:58.425568 15739 leader_election.cc:302] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6749259240264cc288580ca5f731ac78; no voters:
I20260811 19:01:58.425745 15739 leader_election.cc:288] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:58.425778 15763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:58.425966 15763 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [term 1 LEADER]: Becoming Leader. State: Replica: 6749259240264cc288580ca5f731ac78, State: Running, Role: LEADER
I20260811 19:01:58.426033 15739 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:58.426147 15763 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6749259240264cc288580ca5f731ac78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41855 } }
I20260811 19:01:58.426530 15763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6749259240264cc288580ca5f731ac78. Latest consensus state: current_term: 1 leader_uuid: "6749259240264cc288580ca5f731ac78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6749259240264cc288580ca5f731ac78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41855 } } }
I20260811 19:01:58.426662 15763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:58.426927 15783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:58.427078 15772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6749259240264cc288580ca5f731ac78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6749259240264cc288580ca5f731ac78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41855 } } }
I20260811 19:01:58.427219 15772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78 [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:58.427419 15783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:58.428882 15745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:58.425892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:35197 (local address 127.0.0.1:41855)
0811 19:01:58.425925 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:58.425927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:58.425936 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:01:58.426024 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:58.426024 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:58.426033 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:58.426057 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:58.426237 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:58.426815 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:58.427671 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:01:58.427949 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:01:58.428019 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:01:58.428647 (+ 628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:58.428648 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:58.428649 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:58.428653 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:58.428668 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:58.428672 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:58.428732 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:58.428798 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 19:01:58.428807 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 19:01:58.433358 15783 catalog_manager.cc:1347] Generated new cluster ID: 5455a471782a4283b88a2f793909c00b
I20260811 19:01:58.433403 15783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:58.446269 15783 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:58.446769 15783 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:58.453958 15783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6749259240264cc288580ca5f731ac78: Generated new TSK 0
I20260811 19:01:58.454141 15783 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:01:58.461699 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 15584
W20260811 19:01:58.481600 15555 connection.cc:535] client connection to 127.0.0.1:41855 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41855): Connection reset by peer (error 104)
2026-08-11T19:01:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1489 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:01:58 dist-test-slave-gjw7 krb5kdc[15810](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:01:58 dist-test-slave-gjw7 krb5kdc[15810](info): set up 2 sockets
Aug 11 19:01:58 dist-test-slave-gjw7 krb5kdc[15810](info): commencing operation
krb5kdc: starting...
W20260811 19:01:59.703719 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:01:59 dist-test-slave-gjw7 krb5kdc[15810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:01:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:01:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 19:01:59.819551 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40765
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:01:59.900224 15836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:01:59.900420 15836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:01:59.900451 15836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:01:59.901610 15836 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:01:59.901651 15836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:01:59.901669 15836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:01:59.901685 15836 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:01:59.901701 15836 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:01:59.903167 15836 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:01:59.903391 15836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:01:59.903597 15836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:01:59.908097 15854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:59.908109 15850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:01:59.908110 15849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:01:59.908253 15836 server_base.cc:1034] running on GCE node
I20260811 19:01:59.908561 15836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:01:59.908849 15836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:01:59.909989 15836 hybrid_clock.cc:648] HybridClock initialized: now 1786474919909972 us; error 30 us; skew 500 ppm
Aug 11 19:01:59 dist-test-slave-gjw7 krb5kdc[15810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474919, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:01:59.912312 15836 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 19:01:59.912709 15836 webserver.cc:460] Webserver started at http://127.0.0.1:37137/ using document root <none> and password file <none>
I20260811 19:01:59.912925 15836 fs_manager.cc:359] Metadata directory not provided
I20260811 19:01:59.912974 15836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:01:59.913095 15836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:01:59.914134 15836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "4476b13558cf4121b8b3e291949ade6c"
format_stamp: "Formatted at 2026-08-11 19:01:59 on dist-test-slave-gjw7"
server_key: "c24736ec8918c6b31ba0f4f6793786c8"
server_key_iv: "a28544ed006dd5a04a3cf79056abdb40"
server_key_version: "encryptionkey@0"
I20260811 19:01:59.914472 15836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "4476b13558cf4121b8b3e291949ade6c"
format_stamp: "Formatted at 2026-08-11 19:01:59 on dist-test-slave-gjw7"
server_key: "c24736ec8918c6b31ba0f4f6793786c8"
server_key_iv: "a28544ed006dd5a04a3cf79056abdb40"
server_key_version: "encryptionkey@0"
I20260811 19:01:59.915653 15836 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 19:01:59.916289 15865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:01:59.916424 15836 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:01:59.916509 15836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "4476b13558cf4121b8b3e291949ade6c"
format_stamp: "Formatted at 2026-08-11 19:01:59 on dist-test-slave-gjw7"
server_key: "c24736ec8918c6b31ba0f4f6793786c8"
server_key_iv: "a28544ed006dd5a04a3cf79056abdb40"
server_key_version: "encryptionkey@0"
I20260811 19:01:59.916574 15836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:01:59.919734 15836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:01:59.921748 15836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:01:59.921875 15836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:01:59.925698 15836 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40765
I20260811 19:01:59.925727 15980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40765 every 8 connection(s)
I20260811 19:01:59.926023 15836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:01:59.926978 15981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:01:59.929075 15981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c: Bootstrap starting.
I20260811 19:01:59.929623 15981 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c: Neither blocks nor log segments found. Creating new log.
I20260811 19:01:59.929872 15981 log.cc:824] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c: Log is configured to *not* fsync() on all Append() calls
I20260811 19:01:59.930464 15981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c: No bootstrap required, opened a new log
I20260811 19:01:59.932021 15981 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4476b13558cf4121b8b3e291949ade6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40765 } }
I20260811 19:01:59.932154 15981 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:01:59.932174 15981 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4476b13558cf4121b8b3e291949ade6c, State: Initialized, Role: FOLLOWER
I20260811 19:01:59.932302 15981 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4476b13558cf4121b8b3e291949ade6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40765 } }
I20260811 19:01:59.932360 15981 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:01:59.932381 15981 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:01:59.932412 15981 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:01:59.932878 15981 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4476b13558cf4121b8b3e291949ade6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40765 } }
I20260811 19:01:59.932962 15981 leader_election.cc:302] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4476b13558cf4121b8b3e291949ade6c; no voters:
I20260811 19:01:59.933077 15981 leader_election.cc:288] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:01:59.933147 15987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:01:59.933320 15987 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [term 1 LEADER]: Becoming Leader. State: Replica: 4476b13558cf4121b8b3e291949ade6c, State: Running, Role: LEADER
I20260811 19:01:59.933349 15981 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:01:59.933411 15987 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4476b13558cf4121b8b3e291949ade6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40765 } }
I20260811 19:01:59.933749 15989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4476b13558cf4121b8b3e291949ade6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4476b13558cf4121b8b3e291949ade6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40765 } } }
I20260811 19:01:59.933862 15992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4476b13558cf4121b8b3e291949ade6c. Latest consensus state: current_term: 1 leader_uuid: "4476b13558cf4121b8b3e291949ade6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4476b13558cf4121b8b3e291949ade6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40765 } } }
I20260811 19:01:59.933900 15989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:59.933954 15992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c [sys.catalog]: This master's current role is: LEADER
I20260811 19:01:59.934218 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 15836
I20260811 19:01:59.934345 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:01:59.934561 6025 external_mini_cluster.cc:1428] Setting key e86d1cc6a332ec99318adedc531dace2
W20260811 19:01:59.935078 16021 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:01:59.935180 16021 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:01:59.935293 16024 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:01:59.935465 16024 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:01:59.936542 16031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:59.934978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:53273 (local address 127.0.0.1:40765)
0811 19:01:59.935155 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:59.935165 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:59.935234 (+ 69us) server_negotiation.cc:407] Connection header received
0811 19:01:59.935347 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:59.935355 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:59.935386 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:59.935519 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:59.936156 (+ 637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:59.936159 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:59.936160 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:59.936164 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:59.936204 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:59.936215 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:59.936271 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:59.936336 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 19:01:59.936387 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":79,"threads_started":1}
I20260811 19:01:59.937446 16024 catalog_manager.cc:1347] Generated new cluster ID: 5b4a495a8da949ccb645bc7b315213e8
I20260811 19:01:59.937541 16024 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:01:59.937556 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:01:59.939705 16031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:01:59.938798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:55347 (local address 127.0.0.1:40765)
0811 19:01:59.938831 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 19:01:59.938833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:01:59.938933 (+ 100us) server_negotiation.cc:407] Connection header received
0811 19:01:59.938993 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:01:59.938993 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:01:59.938998 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:01:59.939042 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:01:59.939518 (+ 476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:01:59.939520 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:01:59.939520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:01:59.939524 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:01:59.939539 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:01:59.939544 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:01:59.939589 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 19:01:59.939636 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 19:01:59.939649 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 19:01:59.950642 16024 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:01:59.950816 16024 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:01:59.956142 16024 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4476b13558cf4121b8b3e291949ade6c: Generated new TSK 0
I20260811 19:01:59.956314 16024 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:01:59.958720 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 15836
2026-08-11T19:01:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1491 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:02:00 dist-test-slave-gjw7 krb5kdc[16050](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:02:00 dist-test-slave-gjw7 krb5kdc[16050](info): set up 2 sockets
Aug 11 19:02:00 dist-test-slave-gjw7 krb5kdc[16050](info): commencing operation
krb5kdc: starting...
W20260811 19:02:01.177767 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:02:01 dist-test-slave-gjw7 krb5kdc[16050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:02:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:02:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 19:02:01.296223 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33921
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33921
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:02:01.376992 16088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:01.377187 16088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:01.377207 16088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:01.378324 16088 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:01.378365 16088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:01.378377 16088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:01.378388 16088 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:01.378407 16088 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:01.379798 16088 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33921
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:01.379995 16088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:01.380163 16088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:02:01.384579 16100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:01.384611 16107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:01.384677 16098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:01.384810 16088 server_base.cc:1034] running on GCE node
I20260811 19:02:01.385036 16088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:01.385306 16088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:01.386461 16088 hybrid_clock.cc:648] HybridClock initialized: now 1786474921386448 us; error 29 us; skew 500 ppm
Aug 11 19:02:01 dist-test-slave-gjw7 krb5kdc[16050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474921, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:01.388803 16088 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 19:02:01.389202 16088 webserver.cc:460] Webserver started at http://127.0.0.1:38647/ using document root <none> and password file <none>
I20260811 19:02:01.389446 16088 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:01.389489 16088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:01.389581 16088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:01.390540 16088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "4b35d1aafac3452eb8134c63999139bb"
format_stamp: "Formatted at 2026-08-11 19:02:01 on dist-test-slave-gjw7"
server_key: "03c52896a27f7415676d993142eb847f"
server_key_iv: "659320dba0a789040939699d767ff807"
server_key_version: "encryptionkey@0"
I20260811 19:02:01.390827 16088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "4b35d1aafac3452eb8134c63999139bb"
format_stamp: "Formatted at 2026-08-11 19:02:01 on dist-test-slave-gjw7"
server_key: "03c52896a27f7415676d993142eb847f"
server_key_iv: "659320dba0a789040939699d767ff807"
server_key_version: "encryptionkey@0"
I20260811 19:02:01.391981 16088 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:02:01.392590 16117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:01.392735 16088 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:02:01.392812 16088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "4b35d1aafac3452eb8134c63999139bb"
format_stamp: "Formatted at 2026-08-11 19:02:01 on dist-test-slave-gjw7"
server_key: "03c52896a27f7415676d993142eb847f"
server_key_iv: "659320dba0a789040939699d767ff807"
server_key_version: "encryptionkey@0"
I20260811 19:02:01.392875 16088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:01.421743 16088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:01.423904 16088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:01.424039 16088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:01.427961 16088 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33921
I20260811 19:02:01.428006 16240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33921 every 8 connection(s)
I20260811 19:02:01.428339 16088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:02:01.429376 16242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:01.430776 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 16088
I20260811 19:02:01.430891 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:02:01.431109 6025 external_mini_cluster.cc:1428] Setting key 29ef02bc88555e3f4d47b31b68c1ae55
I20260811 19:02:01.432083 16242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb: Bootstrap starting.
I20260811 19:02:01.432736 16242 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:01.433091 16242 log.cc:824] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:01.433807 16242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb: No bootstrap required, opened a new log
I20260811 19:02:01.436051 16242 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b35d1aafac3452eb8134c63999139bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33921 } }
I20260811 19:02:01.436231 16242 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:02:01.436278 16242 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b35d1aafac3452eb8134c63999139bb, State: Initialized, Role: FOLLOWER
I20260811 19:02:01.436414 16242 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b35d1aafac3452eb8134c63999139bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33921 } }
I20260811 19:02:01.436501 16242 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:02:01.436540 16242 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:02:01.436589 16242 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:01.437263 16242 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b35d1aafac3452eb8134c63999139bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33921 } }
I20260811 19:02:01.437393 16242 leader_election.cc:302] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b35d1aafac3452eb8134c63999139bb; no voters:
I20260811 19:02:01.437553 16242 leader_election.cc:288] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:02:01.437579 16251 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:02:01.437687 16251 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [term 1 LEADER]: Becoming Leader. State: Replica: 4b35d1aafac3452eb8134c63999139bb, State: Running, Role: LEADER
Aug 11 19:02:01 dist-test-slave-gjw7 krb5kdc[16050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 19:02:01.437816 16242 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:02:01.437825 16251 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b35d1aafac3452eb8134c63999139bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33921 } }
I20260811 19:02:01.438164 16254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b35d1aafac3452eb8134c63999139bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b35d1aafac3452eb8134c63999139bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33921 } } }
I20260811 19:02:01.438235 16254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:01.438410 16255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b35d1aafac3452eb8134c63999139bb. Latest consensus state: current_term: 1 leader_uuid: "4b35d1aafac3452eb8134c63999139bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b35d1aafac3452eb8134c63999139bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33921 } } }
I20260811 19:02:01.438470 16255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:01.438474 16263 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:02:01.439097 16263 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:02:01.441874 16245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:01.431627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:36285 (local address 127.0.0.1:33921)
0811 19:02:01.431775 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:01.431783 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:01.431808 (+ 25us) server_negotiation.cc:407] Connection header received
0811 19:02:01.432226 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:01.432234 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:01.432285 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:01.432408 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:01.433170 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:01.434155 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:01.435180 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:01.435566 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:01.435636 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:01.438306 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:01.438311 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:01.438311 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:01.438324 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:01.440219 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:01.440621 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:01.440624 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:01.440625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:01.440732 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:01.440936 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:01.440937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:01.440937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:01.441234 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:01.441435 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:01.441571 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 19:02:01.441675 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":58,"threads_started":1}
I20260811 19:02:01.441972 16263 catalog_manager.cc:1347] Generated new cluster ID: 2ef5dd7ef4a34bb78566267cd96c4fc8
I20260811 19:02:01.442013 16263 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:02:01.442855 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:02:01.451143 16245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:01.444319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:50463 (local address 127.0.0.1:33921)
0811 19:02:01.444367 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:01.444369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:01.444591 (+ 222us) server_negotiation.cc:407] Connection header received
0811 19:02:01.444635 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:01.444636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:01.444646 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:01.444710 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:01.445286 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:01.446040 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:01.446990 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:01.447299 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:01.447384 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:01.448605 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:01.448606 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:01.448607 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:01.448614 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:01.450062 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:01.450446 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:01.450447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:01.450447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:01.450503 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:01.450682 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:01.450682 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:01.450683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:01.450799 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:01.450910 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:01.450995 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 19:02:01.451056 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 19:02:01.484164 16263 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:02:01.484721 16263 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:02:01.488472 16263 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b35d1aafac3452eb8134c63999139bb: Generated new TSK 0
I20260811 19:02:01.488643 16263 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:02:01.495990 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 16088
W20260811 19:02:01.510239 16048 connection.cc:535] client connection to 127.0.0.1:33921 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33921): Connection reset by peer (error 104)
2026-08-11T19:02:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1536 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:02:01 dist-test-slave-gjw7 krb5kdc[16297](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:02:01 dist-test-slave-gjw7 krb5kdc[16297](info): set up 2 sockets
Aug 11 19:02:01 dist-test-slave-gjw7 krb5kdc[16297](info): commencing operation
krb5kdc: starting...
W20260811 19:02:02.705772 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:02:02 dist-test-slave-gjw7 krb5kdc[16297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:02:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:02:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 19:02:02.824117 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41171
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41171
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:02:02.905130 16331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:02.905387 16331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:02.905427 16331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:02.906594 16331 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:02.906635 16331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:02.906653 16331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:02.906669 16331 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:02.906685 16331 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:02.908143 16331 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41171
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:02.908401 16331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:02.908607 16331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:02:02.913098 16347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:02.913095 16343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:02.913169 16342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:02.913261 16331 server_base.cc:1034] running on GCE node
I20260811 19:02:02.913548 16331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:02.913839 16331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:02.914987 16331 hybrid_clock.cc:648] HybridClock initialized: now 1786474922914974 us; error 30 us; skew 500 ppm
Aug 11 19:02:02 dist-test-slave-gjw7 krb5kdc[16297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474922, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:02.920056 16331 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 19:02:02.920480 16331 webserver.cc:460] Webserver started at http://127.0.0.1:42019/ using document root <none> and password file <none>
I20260811 19:02:02.920676 16331 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:02.920714 16331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:02.920807 16331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:02.921846 16331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "5840e8beb1724f07a47ddfce2f4562d8"
format_stamp: "Formatted at 2026-08-11 19:02:02 on dist-test-slave-gjw7"
server_key: "cb6ba4905432b0e5ff484a421144bfb5"
server_key_iv: "42193be0c169f786fc63375816f4672c"
server_key_version: "encryptionkey@0"
I20260811 19:02:02.922158 16331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "5840e8beb1724f07a47ddfce2f4562d8"
format_stamp: "Formatted at 2026-08-11 19:02:02 on dist-test-slave-gjw7"
server_key: "cb6ba4905432b0e5ff484a421144bfb5"
server_key_iv: "42193be0c169f786fc63375816f4672c"
server_key_version: "encryptionkey@0"
I20260811 19:02:02.923359 16331 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:02:02.923990 16362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:02.924139 16331 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:02:02.924217 16331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "5840e8beb1724f07a47ddfce2f4562d8"
format_stamp: "Formatted at 2026-08-11 19:02:02 on dist-test-slave-gjw7"
server_key: "cb6ba4905432b0e5ff484a421144bfb5"
server_key_iv: "42193be0c169f786fc63375816f4672c"
server_key_version: "encryptionkey@0"
I20260811 19:02:02.924281 16331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:02.931797 16331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:02.933785 16331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:02.933917 16331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:02.937651 16331 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41171
I20260811 19:02:02.937702 16473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41171 every 8 connection(s)
I20260811 19:02:02.937994 16331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:02:02.938640 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 16331
I20260811 19:02:02.938757 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:02:02.938807 16477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:02.938977 6025 external_mini_cluster.cc:1428] Setting key e1418eba7e189acfd56260683b6e959f
I20260811 19:02:02.942132 16477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8: Bootstrap starting.
I20260811 19:02:02.942700 16477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:02.942994 16477 log.cc:824] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:02.943639 16477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8: No bootstrap required, opened a new log
I20260811 19:02:02.944649 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:02.939417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:57891 (local address 127.0.0.1:41171)
0811 19:02:02.939698 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:02.939707 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:02.939739 (+ 32us) server_negotiation.cc:407] Connection header received
0811 19:02:02.940257 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:02.940267 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:02.940333 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:02.940486 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:02.940687 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:02.942016 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:02.942772 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:02.943325 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:02.943437 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:02.944094 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:02.944098 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:02.944099 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:02:02.944246 (+ 147us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:02.944276 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:02:02.944286 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:02.944351 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:02.944451 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 19:02:02.944478 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":68,"threads_started":1}
I20260811 19:02:02.945581 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:02:02.945731 16477 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5840e8beb1724f07a47ddfce2f4562d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41171 } }
I20260811 19:02:02.945874 16477 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:02:02.945917 16477 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5840e8beb1724f07a47ddfce2f4562d8, State: Initialized, Role: FOLLOWER
I20260811 19:02:02.946035 16477 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5840e8beb1724f07a47ddfce2f4562d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41171 } }
I20260811 19:02:02.946108 16477 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:02:02.946139 16477 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:02:02.946185 16477 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:02.946694 16477 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5840e8beb1724f07a47ddfce2f4562d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41171 } }
I20260811 19:02:02.946790 16477 leader_election.cc:302] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5840e8beb1724f07a47ddfce2f4562d8; no voters:
I20260811 19:02:02.946959 16477 leader_election.cc:288] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:02:02.947012 16512 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:02:02.947165 16512 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5840e8beb1724f07a47ddfce2f4562d8, State: Running, Role: LEADER
I20260811 19:02:02.947172 16477 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:02:02.947258 16512 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5840e8beb1724f07a47ddfce2f4562d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41171 } }
I20260811 19:02:02.947566 16512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5840e8beb1724f07a47ddfce2f4562d8. Latest consensus state: current_term: 1 leader_uuid: "5840e8beb1724f07a47ddfce2f4562d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5840e8beb1724f07a47ddfce2f4562d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41171 } } }
I20260811 19:02:02.947896 16512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:02.948277 16523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:02:02.948743 16523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:02:02.947602 16513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5840e8beb1724f07a47ddfce2f4562d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5840e8beb1724f07a47ddfce2f4562d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41171 } } }
I20260811 19:02:02.949764 16513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:02.950821 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:02.946879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:44545 (local address 127.0.0.1:41171)
0811 19:02:02.946917 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:02.946919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:02.947823 (+ 904us) server_negotiation.cc:407] Connection header received
0811 19:02:02.947893 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:02.947894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:02.947905 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:02.947953 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:02.948151 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:02.948855 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:02.949690 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:02.949982 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:02.950048 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:02.950608 (+ 560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:02.950609 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:02.950610 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:02:02.950614 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:02.950627 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:02:02.950632 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:02.950676 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:02.950742 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 19:02:02.950750 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 19:02:02.956125 16523 catalog_manager.cc:1347] Generated new cluster ID: 08c1870812b44d90b6f13137d6deec9e
I20260811 19:02:02.956167 16523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:02:02.986649 16523 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:02:02.987416 16523 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:02:02.993919 16523 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5840e8beb1724f07a47ddfce2f4562d8: Generated new TSK 0
I20260811 19:02:02.994103 16523 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:02:03.006474 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 16331
W20260811 19:02:03.019682 16294 connection.cc:535] client connection to 127.0.0.1:41171 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41171): Connection reset by peer (error 104)
2026-08-11T19:02:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1509 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:02:03 dist-test-slave-gjw7 krb5kdc[16539](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:02:03 dist-test-slave-gjw7 krb5kdc[16539](info): set up 2 sockets
Aug 11 19:02:03 dist-test-slave-gjw7 krb5kdc[16539](info): commencing operation
krb5kdc: starting...
W20260811 19:02:04.226745 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:02:04 dist-test-slave-gjw7 krb5kdc[16539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474924, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:02:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:02:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 19:02:04.356194 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44667
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44667
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:02:04.438122 16561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:04.438310 16561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:04.438331 16561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:04.439406 16561 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:04.439441 16561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:04.439453 16561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:04.439463 16561 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:04.439474 16561 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:04.440836 16561 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44667
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:04.441016 16561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:04.441177 16561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 19:02:04.445847 16561 server_base.cc:1034] running on GCE node
W20260811 19:02:04.445851 16584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:04.445798 16575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:04.445812 16574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:04.446295 16561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:04.446565 16561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:04.447712 16561 hybrid_clock.cc:648] HybridClock initialized: now 1786474924447701 us; error 25 us; skew 500 ppm
Aug 11 19:02:04 dist-test-slave-gjw7 krb5kdc[16539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474924, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:04.450062 16561 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 19:02:04.450450 16561 webserver.cc:460] Webserver started at http://127.0.0.1:38365/ using document root <none> and password file <none>
I20260811 19:02:04.450619 16561 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:04.450659 16561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:04.450744 16561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:04.451749 16561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "16cff4b385214177abefe22c9bd69d84"
format_stamp: "Formatted at 2026-08-11 19:02:04 on dist-test-slave-gjw7"
server_key: "8e9b56594d3c26456daab6782378dc91"
server_key_iv: "a98290a06c5858ad50911fbc35a80339"
server_key_version: "encryptionkey@0"
I20260811 19:02:04.452036 16561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "16cff4b385214177abefe22c9bd69d84"
format_stamp: "Formatted at 2026-08-11 19:02:04 on dist-test-slave-gjw7"
server_key: "8e9b56594d3c26456daab6782378dc91"
server_key_iv: "a98290a06c5858ad50911fbc35a80339"
server_key_version: "encryptionkey@0"
I20260811 19:02:04.453204 16561 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 19:02:04.453912 16594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:04.454071 16561 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:02:04.454156 16561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "16cff4b385214177abefe22c9bd69d84"
format_stamp: "Formatted at 2026-08-11 19:02:04 on dist-test-slave-gjw7"
server_key: "8e9b56594d3c26456daab6782378dc91"
server_key_iv: "a98290a06c5858ad50911fbc35a80339"
server_key_version: "encryptionkey@0"
I20260811 19:02:04.454210 16561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:04.457329 16561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:04.458957 16561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:04.459055 16561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:04.462729 16561 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44667
I20260811 19:02:04.462774 16690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44667 every 8 connection(s)
I20260811 19:02:04.463054 16561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:02:04.463987 16693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:04.466214 16693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84: Bootstrap starting.
I20260811 19:02:04.466754 16693 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:04.467020 16693 log.cc:824] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:04.467670 16693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84: No bootstrap required, opened a new log
I20260811 19:02:04.469219 16693 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16cff4b385214177abefe22c9bd69d84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44667 } }
I20260811 19:02:04.469389 16693 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:02:04.469434 16693 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16cff4b385214177abefe22c9bd69d84, State: Initialized, Role: FOLLOWER
I20260811 19:02:04.469571 16693 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16cff4b385214177abefe22c9bd69d84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44667 } }
I20260811 19:02:04.469651 16693 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:02:04.469681 16693 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:02:04.469728 16693 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:04.470218 16693 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16cff4b385214177abefe22c9bd69d84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44667 } }
I20260811 19:02:04.470314 16693 leader_election.cc:302] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16cff4b385214177abefe22c9bd69d84; no voters:
I20260811 19:02:04.470460 16693 leader_election.cc:288] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:02:04.470499 16697 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:02:04.470654 16697 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [term 1 LEADER]: Becoming Leader. State: Replica: 16cff4b385214177abefe22c9bd69d84, State: Running, Role: LEADER
I20260811 19:02:04.470692 16693 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:02:04.470754 16697 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16cff4b385214177abefe22c9bd69d84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44667 } }
I20260811 19:02:04.471259 16698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16cff4b385214177abefe22c9bd69d84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16cff4b385214177abefe22c9bd69d84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44667 } } }
I20260811 19:02:04.471335 16698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:04.471385 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 16561
I20260811 19:02:04.471486 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:02:04.471516 16700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16cff4b385214177abefe22c9bd69d84. Latest consensus state: current_term: 1 leader_uuid: "16cff4b385214177abefe22c9bd69d84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16cff4b385214177abefe22c9bd69d84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44667 } } }
I20260811 19:02:04.471586 16700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:04.471669 6025 external_mini_cluster.cc:1428] Setting key a4b17c7367160c6f47809c520952f6bb
I20260811 19:02:04.471973 16712 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:02:04.472493 16712 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:02:04.474058 16712 catalog_manager.cc:1347] Generated new cluster ID: e356716955c7487b9eca7e2730593708
I20260811 19:02:04.474114 16712 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:02:04.474550 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:04.472179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:43349 (local address 127.0.0.1:44667)
0811 19:02:04.472340 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:04.472350 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:04.472522 (+ 172us) server_negotiation.cc:407] Connection header received
0811 19:02:04.472801 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:04.472810 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:04.472842 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:04.472994 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:04.474050 (+ 1056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:04.474053 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:04.474054 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:02:04.474058 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:04.474102 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:02:04.474118 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:04.474172 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:04.474338 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 19:02:04.474389 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260811 19:02:04.475438 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:02:04.477954 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:04.476955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:41031 (local address 127.0.0.1:44667)
0811 19:02:04.476992 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:04.476994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:04.477117 (+ 123us) server_negotiation.cc:407] Connection header received
0811 19:02:04.477175 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:04.477176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:04.477181 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:04.477231 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:04.477755 (+ 524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:04.477756 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:04.477757 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:02:04.477760 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:04.477775 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:02:04.477779 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:04.477826 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:04.477886 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 19:02:04.477898 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 19:02:04.481129 16712 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:02:04.481269 16712 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:02:04.484308 16712 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16cff4b385214177abefe22c9bd69d84: Generated new TSK 0
I20260811 19:02:04.484463 16712 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:02:04.487177 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 16561
2026-08-11T19:02:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1479 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:02:04 dist-test-slave-gjw7 krb5kdc[16743](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:02:04 dist-test-slave-gjw7 krb5kdc[16743](info): set up 2 sockets
Aug 11 19:02:04 dist-test-slave-gjw7 krb5kdc[16743](info): commencing operation
krb5kdc: starting...
W20260811 19:02:05.701368 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:02:05 dist-test-slave-gjw7 krb5kdc[16743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474925, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:02:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:02:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:02:05.816001 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:34963
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:37453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:34963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:02:05.897713 16768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:05.897931 16768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:05.897954 16768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:05.899071 16768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:05.899104 16768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:05.899117 16768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:05.899128 16768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:05.899144 16768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:05.900610 16768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:37453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:34963
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:34963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:05.900817 16768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:05.901000 16768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:02:05.905552 16785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:05.905565 16792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:05.905617 16781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:05.905692 16768 server_base.cc:1034] running on GCE node
I20260811 19:02:05.906001 16768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:05.906271 16768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:05.907407 16768 hybrid_clock.cc:648] HybridClock initialized: now 1786474925907393 us; error 28 us; skew 500 ppm
Aug 11 19:02:05 dist-test-slave-gjw7 krb5kdc[16743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474925, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:05.909817 16768 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:02:05.910243 16768 webserver.cc:460] Webserver started at http://127.5.226.126:41211/ using document root <none> and password file <none>
I20260811 19:02:05.910430 16768 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:05.910470 16768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:05.910555 16768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:05.911522 16768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "96d7c96d895c429a8e86cd2689943649"
format_stamp: "Formatted at 2026-08-11 19:02:05 on dist-test-slave-gjw7"
server_key: "5e1d57aa36e30d8864bf91117df8127e"
server_key_iv: "c0874701a04b717de5437a8a833682a5"
server_key_version: "encryptionkey@0"
I20260811 19:02:05.911857 16768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "96d7c96d895c429a8e86cd2689943649"
format_stamp: "Formatted at 2026-08-11 19:02:05 on dist-test-slave-gjw7"
server_key: "5e1d57aa36e30d8864bf91117df8127e"
server_key_iv: "c0874701a04b717de5437a8a833682a5"
server_key_version: "encryptionkey@0"
I20260811 19:02:05.913056 16768 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 19:02:05.913707 16802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:05.913833 16768 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:05.913923 16768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "96d7c96d895c429a8e86cd2689943649"
format_stamp: "Formatted at 2026-08-11 19:02:05 on dist-test-slave-gjw7"
server_key: "5e1d57aa36e30d8864bf91117df8127e"
server_key_iv: "c0874701a04b717de5437a8a833682a5"
server_key_version: "encryptionkey@0"
I20260811 19:02:05.913980 16768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:05.927579 16768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:05.929674 16768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:05.929808 16768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:05.933651 16768 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:34963
I20260811 19:02:05.933686 16923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:34963 every 8 connection(s)
I20260811 19:02:05.934010 16768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:02:05.934875 16924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:05.937150 16924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649: Bootstrap starting.
I20260811 19:02:05.937768 16924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:05.938032 16924 log.cc:824] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:05.938675 16924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649: No bootstrap required, opened a new log
I20260811 19:02:05.940231 16924 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96d7c96d895c429a8e86cd2689943649" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34963 } }
I20260811 19:02:05.940371 16924 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:02:05.940404 16924 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96d7c96d895c429a8e86cd2689943649, State: Initialized, Role: FOLLOWER
I20260811 19:02:05.940538 16924 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96d7c96d895c429a8e86cd2689943649" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34963 } }
I20260811 19:02:05.940625 16924 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:02:05.940663 16924 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:02:05.940712 16924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:05.940740 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 16768
I20260811 19:02:05.940860 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:02:05.941063 6025 external_mini_cluster.cc:1428] Setting key 74377d801cc927a24e95bb3b57d23854
I20260811 19:02:05.941763 16924 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96d7c96d895c429a8e86cd2689943649" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34963 } }
I20260811 19:02:05.941879 16924 leader_election.cc:302] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96d7c96d895c429a8e86cd2689943649; no voters:
I20260811 19:02:05.942034 16924 leader_election.cc:288] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:02:05.942076 16931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:02:05.942306 16931 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [term 1 LEADER]: Becoming Leader. State: Replica: 96d7c96d895c429a8e86cd2689943649, State: Running, Role: LEADER
I20260811 19:02:05.942390 16924 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:02:05.942430 16931 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96d7c96d895c429a8e86cd2689943649" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34963 } }
I20260811 19:02:05.942749 16931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96d7c96d895c429a8e86cd2689943649. Latest consensus state: current_term: 1 leader_uuid: "96d7c96d895c429a8e86cd2689943649" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96d7c96d895c429a8e86cd2689943649" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34963 } } }
I20260811 19:02:05.942956 16931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:05.942885 16932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96d7c96d895c429a8e86cd2689943649" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96d7c96d895c429a8e86cd2689943649" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34963 } } }
I20260811 19:02:05.943387 16932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:05.943384 16943 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:02:05.943943 16943 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:02:05.945463 16943 catalog_manager.cc:1347] Generated new cluster ID: d5a8f2a1fb854e31bb7f8d6b1c896c23
I20260811 19:02:05.945508 16943 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 19:02:05 dist-test-slave-gjw7 krb5kdc[16743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474925, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:02:05.952414 16930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:05.941557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60561 (local address 127.5.226.126:34963)
0811 19:02:05.941741 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:05.941750 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:05.941778 (+ 28us) server_negotiation.cc:407] Connection header received
0811 19:02:05.941902 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:05.941910 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:05.941966 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:05.942137 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:05.942915 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:05.944345 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:05.945398 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:05.945954 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:05.946053 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:05.948808 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:05.948812 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:05.948812 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:05.948825 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:05.950755 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:05.951195 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:05.951198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:05.951198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:05.951309 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:05.951549 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:05.951549 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:05.951550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:05.951820 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:05.951975 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:05.952096 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 19:02:05.952191 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":93,"threads_started":1}
I20260811 19:02:05.953353 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:02:05.957510 16943 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:02:05.957988 16943 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:02:05.961786 16930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:05.954758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39541 (local address 127.5.226.126:34963)
0811 19:02:05.954796 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:05.954798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:05.954965 (+ 167us) server_negotiation.cc:407] Connection header received
0811 19:02:05.955023 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:05.955024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:05.955033 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:05.955068 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:05.955638 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:05.956387 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:05.957431 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:05.957763 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:05.957801 (+ 38us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:05.959161 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:05.959162 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:05.959162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:05.959169 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:05.960558 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:05.960940 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:05.960941 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:05.960942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:05.960991 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:05.961182 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:05.961183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:05.961183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:05.961285 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:05.961405 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:05.961629 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 19:02:05.961697 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 19:02:05.964995 16943 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96d7c96d895c429a8e86cd2689943649: Generated new TSK 0
I20260811 19:02:05.965143 16943 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:02:05.967293 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 16768
W20260811 19:02:05.989751 16739 connection.cc:535] client connection to 127.5.226.126:34963 recv error: Network error: failed to read from TLS socket (remote: 127.5.226.126:34963): Connection reset by peer (error 104)
2026-08-11T19:02:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1490 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:02:06 dist-test-slave-gjw7 krb5kdc[16979](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:02:06 dist-test-slave-gjw7 krb5kdc[16979](info): set up 2 sockets
Aug 11 19:02:06 dist-test-slave-gjw7 krb5kdc[16979](info): commencing operation
krb5kdc: starting...
W20260811 19:02:07.181475 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:02:07 dist-test-slave-gjw7 krb5kdc[16979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:02:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:02:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:02:07.304545 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:45679
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:39837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:45679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:02:07.384835 17007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:07.385041 17007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:07.385062 17007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:07.386176 17007 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:07.386216 17007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:07.386229 17007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:07.386251 17007 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:07.386267 17007 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:07.387696 17007 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:39837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:45679
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:45679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:07.387923 17007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:07.388124 17007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:02:07.392678 17020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:07.392697 17014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:07.392692 17013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:07.393035 17007 server_base.cc:1034] running on GCE node
I20260811 19:02:07.393283 17007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:07.393607 17007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:07.394742 17007 hybrid_clock.cc:648] HybridClock initialized: now 1786474927394724 us; error 34 us; skew 500 ppm
Aug 11 19:02:07 dist-test-slave-gjw7 krb5kdc[16979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474927, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:07.397107 17007 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:02:07.397560 17007 webserver.cc:460] Webserver started at http://127.5.226.126:37419/ using document root <none> and password file <none>
I20260811 19:02:07.397766 17007 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:07.397806 17007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:07.397905 17007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:07.398989 17007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "b3ac13c88a4c4153b7b1f7dc23f6e158"
format_stamp: "Formatted at 2026-08-11 19:02:07 on dist-test-slave-gjw7"
server_key: "6826c85820c7284cfbb3130bc52a8410"
server_key_iv: "0871d3f79cecc1e8cf2ec36c68540025"
server_key_version: "encryptionkey@0"
I20260811 19:02:07.399283 17007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "b3ac13c88a4c4153b7b1f7dc23f6e158"
format_stamp: "Formatted at 2026-08-11 19:02:07 on dist-test-slave-gjw7"
server_key: "6826c85820c7284cfbb3130bc52a8410"
server_key_iv: "0871d3f79cecc1e8cf2ec36c68540025"
server_key_version: "encryptionkey@0"
I20260811 19:02:07.400470 17007 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 19:02:07.401093 17034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:07.401240 17007 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:02:07.401345 17007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "b3ac13c88a4c4153b7b1f7dc23f6e158"
format_stamp: "Formatted at 2026-08-11 19:02:07 on dist-test-slave-gjw7"
server_key: "6826c85820c7284cfbb3130bc52a8410"
server_key_iv: "0871d3f79cecc1e8cf2ec36c68540025"
server_key_version: "encryptionkey@0"
I20260811 19:02:07.401412 17007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:07.424782 17007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:07.426658 17007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:07.426803 17007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:07.430871 17007 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:45679
I20260811 19:02:07.430912 17156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:45679 every 8 connection(s)
I20260811 19:02:07.431257 17007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:02:07.432124 17157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:07.434558 17157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158: Bootstrap starting.
I20260811 19:02:07.435155 17157 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:07.435433 17157 log.cc:824] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:07.436125 17157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158: No bootstrap required, opened a new log
I20260811 19:02:07.437819 17157 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ac13c88a4c4153b7b1f7dc23f6e158" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45679 } }
I20260811 19:02:07.437971 17157 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:02:07.438004 17157 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ac13c88a4c4153b7b1f7dc23f6e158, State: Initialized, Role: FOLLOWER
I20260811 19:02:07.438159 17157 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ac13c88a4c4153b7b1f7dc23f6e158" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45679 } }
I20260811 19:02:07.438238 17157 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:02:07.438274 17157 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:02:07.438321 17157 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:07.439168 17157 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ac13c88a4c4153b7b1f7dc23f6e158" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45679 } }
I20260811 19:02:07.439285 17157 leader_election.cc:302] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3ac13c88a4c4153b7b1f7dc23f6e158; no voters:
I20260811 19:02:07.439393 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 17007
I20260811 19:02:07.439478 17157 leader_election.cc:288] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:02:07.439509 17163 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:02:07.439522 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:02:07.439684 17163 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [term 1 LEADER]: Becoming Leader. State: Replica: b3ac13c88a4c4153b7b1f7dc23f6e158, State: Running, Role: LEADER
I20260811 19:02:07.439734 6025 external_mini_cluster.cc:1428] Setting key 420ce2720aed0266d1993921ef00ae3a
I20260811 19:02:07.439767 17157 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:02:07.439800 17163 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ac13c88a4c4153b7b1f7dc23f6e158" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45679 } }
I20260811 19:02:07.440148 17163 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3ac13c88a4c4153b7b1f7dc23f6e158. Latest consensus state: current_term: 1 leader_uuid: "b3ac13c88a4c4153b7b1f7dc23f6e158" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ac13c88a4c4153b7b1f7dc23f6e158" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45679 } } }
I20260811 19:02:07.440228 17163 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:07.440346 17166 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3ac13c88a4c4153b7b1f7dc23f6e158" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ac13c88a4c4153b7b1f7dc23f6e158" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 45679 } } }
I20260811 19:02:07.440518 17166 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:07.440646 17177 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:02:07.441220 17177 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:02:07.442869 17177 catalog_manager.cc:1347] Generated new cluster ID: b86acf05529f4019a87a1035e4f3427b
I20260811 19:02:07.442915 17177 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:02:07.446463 17175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:07.440259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40685 (local address 127.5.226.126:45679)
0811 19:02:07.440983 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:07.440994 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:07.441031 (+ 37us) server_negotiation.cc:407] Connection header received
0811 19:02:07.441160 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:07.441168 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:07.441236 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:07.441644 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:07.441740 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:07.443102 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:07.444175 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:07.444808 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:07.445334 (+ 526us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:07.445750 (+ 416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:07.445754 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:07.445754 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:02:07.445963 (+ 209us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:07.446004 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:02:07.446019 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:07.446100 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:07.446214 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 19:02:07.446243 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":76,"threads_started":1}
I20260811 19:02:07.447387 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:02:07.452595 17175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:07.448983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35397 (local address 127.5.226.126:45679)
0811 19:02:07.449032 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:07.449033 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:07.449312 (+ 279us) server_negotiation.cc:407] Connection header received
0811 19:02:07.449380 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:07.449380 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:07.449390 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:07.449444 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:07.449572 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:07.450314 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:07.451315 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:07.451616 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:07.451669 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:07.452345 (+ 676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:07.452347 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:07.452347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:02:07.452352 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:07.452374 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:02:07.452379 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:07.452428 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:07.452508 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 19:02:07.452521 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 19:02:07.457391 17177 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:02:07.458123 17177 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:02:07.473189 17177 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3ac13c88a4c4153b7b1f7dc23f6e158: Generated new TSK 0
I20260811 19:02:07.473443 17177 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:02:07.482224 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 17007
W20260811 19:02:07.502318 16974 connection.cc:535] client connection to 127.5.226.126:45679 recv error: Network error: failed to read from TLS socket (remote: 127.5.226.126:45679): Connection reset by peer (error 104)
2026-08-11T19:02:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1512 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:02:07 dist-test-slave-gjw7 krb5kdc[17213](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:02:07 dist-test-slave-gjw7 krb5kdc[17213](info): set up 2 sockets
Aug 11 19:02:07 dist-test-slave-gjw7 krb5kdc[17213](info): commencing operation
krb5kdc: starting...
W20260811 19:02:08.706004 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:02:08 dist-test-slave-gjw7 krb5kdc[17213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:02:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:02:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:02:08.831998 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:43663
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:40601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:43663
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:02:08.916698 17236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:08.916916 17236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:08.916940 17236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:08.918176 17236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:08.918231 17236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:08.918246 17236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:08.918259 17236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:08.918282 17236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:08.919844 17236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:40601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:43663
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:43663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:08.920110 17236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:08.920372 17236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:02:08.925493 17243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:08.925509 17236 server_base.cc:1034] running on GCE node
W20260811 19:02:08.925514 17242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:08.925493 17245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:08.926025 17236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:08.926342 17236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:08.927495 17236 hybrid_clock.cc:648] HybridClock initialized: now 1786474928927471 us; error 37 us; skew 500 ppm
Aug 11 19:02:08 dist-test-slave-gjw7 krb5kdc[17213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474928, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:08.934665 17236 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:02:08.935182 17236 webserver.cc:460] Webserver started at http://127.5.226.126:46161/ using document root <none> and password file <none>
I20260811 19:02:08.935424 17236 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:08.935477 17236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:08.935614 17236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:08.936794 17236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "1efbff0fae4445c59302c81b121f662c"
format_stamp: "Formatted at 2026-08-11 19:02:08 on dist-test-slave-gjw7"
server_key: "dc6466697744f22ab51509a901680b42"
server_key_iv: "20a5bc76d9b9ae67f1e41cb06a4478b6"
server_key_version: "encryptionkey@0"
I20260811 19:02:08.937147 17236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "1efbff0fae4445c59302c81b121f662c"
format_stamp: "Formatted at 2026-08-11 19:02:08 on dist-test-slave-gjw7"
server_key: "dc6466697744f22ab51509a901680b42"
server_key_iv: "20a5bc76d9b9ae67f1e41cb06a4478b6"
server_key_version: "encryptionkey@0"
I20260811 19:02:08.938551 17236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 19:02:08.939277 17261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:08.939435 17236 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:08.939530 17236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "1efbff0fae4445c59302c81b121f662c"
format_stamp: "Formatted at 2026-08-11 19:02:08 on dist-test-slave-gjw7"
server_key: "dc6466697744f22ab51509a901680b42"
server_key_iv: "20a5bc76d9b9ae67f1e41cb06a4478b6"
server_key_version: "encryptionkey@0"
I20260811 19:02:08.939596 17236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:08.943115 17236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:08.944949 17236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:08.945081 17236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:08.949069 17236 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:43663
I20260811 19:02:08.949103 17376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:43663 every 8 connection(s)
I20260811 19:02:08.949467 17236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:02:08.950469 17380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:08.952804 17380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c: Bootstrap starting.
I20260811 19:02:08.953446 17380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:08.953740 17380 log.cc:824] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:08.954504 17380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c: No bootstrap required, opened a new log
I20260811 19:02:08.956147 17380 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1efbff0fae4445c59302c81b121f662c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 43663 } }
I20260811 19:02:08.956295 17380 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:02:08.956317 17380 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1efbff0fae4445c59302c81b121f662c, State: Initialized, Role: FOLLOWER
I20260811 19:02:08.956456 17380 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1efbff0fae4445c59302c81b121f662c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 43663 } }
I20260811 19:02:08.956519 17380 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:02:08.956542 17380 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:02:08.956588 17380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:08.957486 17380 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1efbff0fae4445c59302c81b121f662c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 43663 } }
I20260811 19:02:08.957587 17380 leader_election.cc:302] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1efbff0fae4445c59302c81b121f662c; no voters:
I20260811 19:02:08.957762 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 17236
I20260811 19:02:08.957784 17380 leader_election.cc:288] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:02:08.957818 17392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:02:08.957890 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:02:08.958021 17392 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [term 1 LEADER]: Becoming Leader. State: Replica: 1efbff0fae4445c59302c81b121f662c, State: Running, Role: LEADER
I20260811 19:02:08.958067 17380 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:02:08.958125 6025 external_mini_cluster.cc:1428] Setting key f64e4c435d6ed8009f3f23832b422168
I20260811 19:02:08.958137 17392 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1efbff0fae4445c59302c81b121f662c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 43663 } }
I20260811 19:02:08.958575 17393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1efbff0fae4445c59302c81b121f662c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1efbff0fae4445c59302c81b121f662c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 43663 } } }
I20260811 19:02:08.958653 17393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:08.958858 17394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1efbff0fae4445c59302c81b121f662c. Latest consensus state: current_term: 1 leader_uuid: "1efbff0fae4445c59302c81b121f662c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1efbff0fae4445c59302c81b121f662c" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 43663 } } }
I20260811 19:02:08.958922 17394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:08.959314 17403 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:02:08.959862 17403 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:02:08.961084 17411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:08.958788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42947 (local address 127.5.226.126:43663)
0811 19:02:08.959215 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:08.959226 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:08.959266 (+ 40us) server_negotiation.cc:407] Connection header received
0811 19:02:08.959407 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:08.959414 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:08.959448 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:08.959594 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:08.960497 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:08.960500 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:08.960501 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:02:08.960505 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:08.960542 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:02:08.960554 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:08.960619 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:08.960742 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 19:02:08.960866 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":83,"threads_started":1}
I20260811 19:02:08.961633 17403 catalog_manager.cc:1347] Generated new cluster ID: 66ca0be456c14d569f33303233a45370
I20260811 19:02:08.961699 17403 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:02:08.962093 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:02:08.964699 17411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:08.963615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33463 (local address 127.5.226.126:43663)
0811 19:02:08.963645 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:08.963647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:08.963798 (+ 151us) server_negotiation.cc:407] Connection header received
0811 19:02:08.963874 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:08.963875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:08.963880 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:08.963926 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:08.964506 (+ 580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:08.964508 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:08.964508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:02:08.964512 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:08.964527 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:02:08.964531 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:08.964577 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:08.964629 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 19:02:08.964641 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 19:02:08.973320 17403 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:02:08.973503 17403 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:02:08.980659 17403 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1efbff0fae4445c59302c81b121f662c: Generated new TSK 0
I20260811 19:02:08.980883 17403 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:02:08.984759 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 17236
2026-08-11T19:02:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1501 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:02:09 dist-test-slave-gjw7 krb5kdc[17447](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:02:09 dist-test-slave-gjw7 krb5kdc[17447](info): set up 2 sockets
Aug 11 19:02:09 dist-test-slave-gjw7 krb5kdc[17447](info): commencing operation
krb5kdc: starting...
W20260811 19:02:10.210566 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:02:10 dist-test-slave-gjw7 krb5kdc[17447](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:02:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:02:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:02:10.334476 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:34931
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:46655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:34931
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:02:10.420150 17477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:10.420379 17477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:10.420403 17477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:10.421540 17477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:10.421581 17477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:10.421595 17477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:10.421612 17477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:10.421633 17477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:10.423089 17477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:46655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:34931
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:34931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:10.423309 17477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:10.423493 17477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:02:10.428179 17495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:10.428202 17494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:10.428182 17497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:10.428383 17477 server_base.cc:1034] running on GCE node
I20260811 19:02:10.428615 17477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:10.428902 17477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:10.430045 17477 hybrid_clock.cc:648] HybridClock initialized: now 1786474930430028 us; error 30 us; skew 500 ppm
Aug 11 19:02:10 dist-test-slave-gjw7 krb5kdc[17447](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474930, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:10.432402 17477 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:02:10.432849 17477 webserver.cc:460] Webserver started at http://127.5.226.126:34531/ using document root <none> and password file <none>
I20260811 19:02:10.433054 17477 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:10.433104 17477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:10.433230 17477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:10.434300 17477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "d1ebe39ed5de491c9fec67074277a79b"
format_stamp: "Formatted at 2026-08-11 19:02:10 on dist-test-slave-gjw7"
server_key: "b1911227bf9bc591345536aebdb6ebbc"
server_key_iv: "9d517cc7e82ada74c5d9423072495a65"
server_key_version: "encryptionkey@0"
I20260811 19:02:10.434645 17477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "d1ebe39ed5de491c9fec67074277a79b"
format_stamp: "Formatted at 2026-08-11 19:02:10 on dist-test-slave-gjw7"
server_key: "b1911227bf9bc591345536aebdb6ebbc"
server_key_iv: "9d517cc7e82ada74c5d9423072495a65"
server_key_version: "encryptionkey@0"
I20260811 19:02:10.435927 17477 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:02:10.436600 17513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:10.436754 17477 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:02:10.436841 17477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "d1ebe39ed5de491c9fec67074277a79b"
format_stamp: "Formatted at 2026-08-11 19:02:10 on dist-test-slave-gjw7"
server_key: "b1911227bf9bc591345536aebdb6ebbc"
server_key_iv: "9d517cc7e82ada74c5d9423072495a65"
server_key_version: "encryptionkey@0"
I20260811 19:02:10.436915 17477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:10.446393 17477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:10.448817 17477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:10.448953 17477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:10.452932 17477 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:34931
I20260811 19:02:10.452965 17622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:34931 every 8 connection(s)
I20260811 19:02:10.453320 17477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:02:10.454159 17623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:10.456449 17623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b: Bootstrap starting.
I20260811 19:02:10.457021 17623 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:10.457276 17623 log.cc:824] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:10.457935 17623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b: No bootstrap required, opened a new log
I20260811 19:02:10.459492 17623 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ebe39ed5de491c9fec67074277a79b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34931 } }
I20260811 19:02:10.459631 17623 raft_consensus.cc:374] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:02:10.459652 17623 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1ebe39ed5de491c9fec67074277a79b, State: Initialized, Role: FOLLOWER
I20260811 19:02:10.459790 17623 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ebe39ed5de491c9fec67074277a79b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34931 } }
I20260811 19:02:10.459853 17623 raft_consensus.cc:388] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:02:10.459877 17623 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:02:10.459920 17623 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:10.460130 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 17477
I20260811 19:02:10.460270 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:02:10.460461 6025 external_mini_cluster.cc:1428] Setting key 9bbb380d95b1efbb1e7f1c84979cc196
I20260811 19:02:10.460785 17623 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ebe39ed5de491c9fec67074277a79b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34931 } }
I20260811 19:02:10.460928 17623 leader_election.cc:302] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1ebe39ed5de491c9fec67074277a79b; no voters:
I20260811 19:02:10.461083 17623 leader_election.cc:288] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:02:10.461107 17638 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:02:10.461264 17638 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [term 1 LEADER]: Becoming Leader. State: Replica: d1ebe39ed5de491c9fec67074277a79b, State: Running, Role: LEADER
I20260811 19:02:10.461436 17623 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:02:10.461424 17638 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ebe39ed5de491c9fec67074277a79b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34931 } }
I20260811 19:02:10.461962 17643 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1ebe39ed5de491c9fec67074277a79b. Latest consensus state: current_term: 1 leader_uuid: "d1ebe39ed5de491c9fec67074277a79b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ebe39ed5de491c9fec67074277a79b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34931 } } }
I20260811 19:02:10.462170 17643 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:10.462108 17642 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d1ebe39ed5de491c9fec67074277a79b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ebe39ed5de491c9fec67074277a79b" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34931 } } }
I20260811 19:02:10.462603 17642 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:10.462667 17655 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:02:10.463132 17655 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:02:10.464720 17655 catalog_manager.cc:1347] Generated new cluster ID: f31a02a46f4148cd95ea70db516a3817
I20260811 19:02:10.464772 17655 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 19:02:10 dist-test-slave-gjw7 krb5kdc[17447](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:02:10.471817 17631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:10.460932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58525 (local address 127.5.226.126:34931)
0811 19:02:10.461109 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:10.461118 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:10.461329 (+ 211us) server_negotiation.cc:407] Connection header received
0811 19:02:10.461455 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:10.461463 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:10.461523 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:10.461661 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:10.462516 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:10.463792 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:10.464713 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:10.465315 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:10.465409 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:10.468115 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:10.468118 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:10.468119 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:10.468131 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:10.469977 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:10.470328 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:10.470331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:10.470332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:10.470439 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:10.470597 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:10.470598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:10.470598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:10.470881 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:10.471005 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:10.471449 (+ 444us) server_negotiation.cc:299] Negotiation successful
0811 19:02:10.471579 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260811 19:02:10.472750 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:02:10.474741 17655 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:02:10.475419 17655 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:02:10.478669 17655 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d1ebe39ed5de491c9fec67074277a79b: Generated new TSK 0
I20260811 19:02:10.478842 17655 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:02:10.480034 17631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:10.474245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38635 (local address 127.5.226.126:34931)
0811 19:02:10.474285 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:10.474287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:10.474353 (+ 66us) server_negotiation.cc:407] Connection header received
0811 19:02:10.474406 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:10.474407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:10.474416 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:10.474463 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:10.475067 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:10.475556 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:10.476239 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:10.476455 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:10.476508 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:10.477607 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:10.477609 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:10.477609 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:10.477616 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:10.479070 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:10.479369 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:10.479370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:10.479370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:10.479424 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:10.479578 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:10.479579 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:10.479579 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:10.479689 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:10.479770 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:10.479873 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 19:02:10.479956 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 19:02:10.481988 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 17477
2026-08-11T19:02:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1497 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:02:10 dist-test-slave-gjw7 krb5kdc[17684](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:02:10 dist-test-slave-gjw7 krb5kdc[17684](info): set up 2 sockets
Aug 11 19:02:10 dist-test-slave-gjw7 krb5kdc[17684](info): commencing operation
krb5kdc: starting...
W20260811 19:02:11.784595 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:02:11 dist-test-slave-gjw7 krb5kdc[17684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:02:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:02:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:02:11.961179 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:40915
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:38061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:40915
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:02:12.106189 17717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:12.106611 17717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:12.106694 17717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:12.108500 17717 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:12.108566 17717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:12.108619 17717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:12.108667 17717 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:12.108723 17717 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:12.111335 17717 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:38061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:40915
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:40915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:12.111788 17717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:12.112214 17717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:02:12.120342 17730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:12.120354 17725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:12.120342 17734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:12.120872 17717 server_base.cc:1034] running on GCE node
I20260811 19:02:12.121264 17717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:12.121812 17717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:12.123028 17717 hybrid_clock.cc:648] HybridClock initialized: now 1786474932122994 us; error 50 us; skew 500 ppm
Aug 11 19:02:12 dist-test-slave-gjw7 krb5kdc[17684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474932, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:12.127265 17717 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:02:12.128115 17717 webserver.cc:460] Webserver started at http://127.5.226.126:33905/ using document root <none> and password file <none>
I20260811 19:02:12.128543 17717 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:12.128630 17717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:12.128822 17717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:12.130734 17717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "eff707e7a57346d48693b9225b6288d1"
format_stamp: "Formatted at 2026-08-11 19:02:12 on dist-test-slave-gjw7"
server_key: "701845d655c9d72672aa8db86b7971ee"
server_key_iv: "37bf55846ea335606bfda7f08e307d7c"
server_key_version: "encryptionkey@0"
I20260811 19:02:12.131353 17717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "eff707e7a57346d48693b9225b6288d1"
format_stamp: "Formatted at 2026-08-11 19:02:12 on dist-test-slave-gjw7"
server_key: "701845d655c9d72672aa8db86b7971ee"
server_key_iv: "37bf55846ea335606bfda7f08e307d7c"
server_key_version: "encryptionkey@0"
I20260811 19:02:12.133790 17717 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260811 19:02:12.134954 17751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:12.135239 17717 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:02:12.135389 17717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "eff707e7a57346d48693b9225b6288d1"
format_stamp: "Formatted at 2026-08-11 19:02:12 on dist-test-slave-gjw7"
server_key: "701845d655c9d72672aa8db86b7971ee"
server_key_iv: "37bf55846ea335606bfda7f08e307d7c"
server_key_version: "encryptionkey@0"
I20260811 19:02:12.135493 17717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:12.163069 17717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:12.166556 17717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:12.166764 17717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:12.173569 17717 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:40915
I20260811 19:02:12.173648 17853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:40915 every 8 connection(s)
I20260811 19:02:12.174223 17717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:02:12.175704 17854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:12.180183 17854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1: Bootstrap starting.
I20260811 19:02:12.180330 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 17717
I20260811 19:02:12.180553 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:02:12.180940 6025 external_mini_cluster.cc:1428] Setting key 5a326ffc7fe3fd0c5880a79241535bc4
I20260811 19:02:12.181607 17854 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:12.182555 17854 log.cc:824] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:12.183979 17854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1: No bootstrap required, opened a new log
I20260811 19:02:12.188176 17854 raft_consensus.cc:348] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eff707e7a57346d48693b9225b6288d1" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40915 } }
I20260811 19:02:12.188452 17854 raft_consensus.cc:374] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:02:12.188493 17854 raft_consensus.cc:729] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eff707e7a57346d48693b9225b6288d1, State: Initialized, Role: FOLLOWER
I20260811 19:02:12.188709 17854 consensus_queue.cc:260] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eff707e7a57346d48693b9225b6288d1" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40915 } }
I20260811 19:02:12.188820 17854 raft_consensus.cc:388] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:02:12.188874 17854 raft_consensus.cc:482] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:02:12.188954 17854 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:12.190250 17854 raft_consensus.cc:504] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eff707e7a57346d48693b9225b6288d1" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40915 } }
I20260811 19:02:12.190413 17854 leader_election.cc:302] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eff707e7a57346d48693b9225b6288d1; no voters:
I20260811 19:02:12.190729 17854 leader_election.cc:288] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:02:12.190781 17873 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:02:12.191118 17873 raft_consensus.cc:686] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [term 1 LEADER]: Becoming Leader. State: Replica: eff707e7a57346d48693b9225b6288d1, State: Running, Role: LEADER
I20260811 19:02:12.191284 17865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:12.181942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59633 (local address 127.5.226.126:40915)
0811 19:02:12.182232 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:12.182256 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:12.182334 (+ 78us) server_negotiation.cc:407] Connection header received
0811 19:02:12.183323 (+ 989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:12.183345 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:12.183478 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:12.183727 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:12.184413 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:12.186403 (+ 1990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:12.188102 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:12.188918 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:12.189076 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:12.190111 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:12.190122 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:12.190122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:02:12.190400 (+ 278us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:12.190480 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:02:12.190512 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:12.190603 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:12.190731 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 19:02:12.190882 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":97,"threads_started":1}
I20260811 19:02:12.191305 17854 sys_catalog.cc:564] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:02:12.191488 17873 consensus_queue.cc:237] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eff707e7a57346d48693b9225b6288d1" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40915 } }
I20260811 19:02:12.192078 17874 sys_catalog.cc:455] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eff707e7a57346d48693b9225b6288d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eff707e7a57346d48693b9225b6288d1" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40915 } } }
I20260811 19:02:12.192209 17874 sys_catalog.cc:458] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:12.193246 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:02:12.193243 17875 sys_catalog.cc:455] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eff707e7a57346d48693b9225b6288d1. Latest consensus state: current_term: 1 leader_uuid: "eff707e7a57346d48693b9225b6288d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eff707e7a57346d48693b9225b6288d1" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 40915 } } }
I20260811 19:02:12.193432 17875 sys_catalog.cc:458] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:12.193953 17886 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:02:12.194717 17886 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:02:12.197110 17886 catalog_manager.cc:1347] Generated new cluster ID: 3a1503408d354fc3a7c86e233653461b
I20260811 19:02:12.197216 17886 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:02:12.200471 17865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:12.196114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55687 (local address 127.5.226.126:40915)
0811 19:02:12.196186 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:12.196198 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:12.196515 (+ 317us) server_negotiation.cc:407] Connection header received
0811 19:02:12.196640 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:12.196641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:12.196661 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:12.196741 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:12.196920 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:12.197798 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:12.198798 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:12.199116 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:12.199221 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:12.200086 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:12.200087 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:12.200087 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:02:12.200092 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:12.200118 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:02:12.200123 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:12.200193 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:12.200299 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 19:02:12.200343 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 19:02:12.216104 17886 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:02:12.216884 17886 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:02:12.221392 17886 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eff707e7a57346d48693b9225b6288d1: Generated new TSK 0
I20260811 19:02:12.221691 17886 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:02:12.227833 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 17717
2026-08-11T19:02:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1746 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:02:12 dist-test-slave-gjw7 krb5kdc[17931](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:02:12 dist-test-slave-gjw7 krb5kdc[17931](info): set up 2 sockets
Aug 11 19:02:12 dist-test-slave-gjw7 krb5kdc[17931](info): commencing operation
krb5kdc: starting...
W20260811 19:02:13.793282 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.532s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:02:13 dist-test-slave-gjw7 krb5kdc[17931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:02:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:02:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:02:13.915642 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:34057
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:42237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:34057
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:02:13.997777 17958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:13.997997 17958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:13.998018 17958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:13.999138 17958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:13.999179 17958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:13.999191 17958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:13.999202 17958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:13.999213 17958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:14.000707 17958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:42237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:34057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:34057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:14.000952 17958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:14.001163 17958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:02:14.005820 17965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:14.005908 17968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:14.005827 17964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:14.006016 17958 server_base.cc:1034] running on GCE node
I20260811 19:02:14.006253 17958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:14.006553 17958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:14.007690 17958 hybrid_clock.cc:648] HybridClock initialized: now 1786474934007676 us; error 35 us; skew 500 ppm
Aug 11 19:02:14 dist-test-slave-gjw7 krb5kdc[17931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474934, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:14.013787 17958 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:02:14.014262 17958 webserver.cc:460] Webserver started at http://127.5.226.126:46421/ using document root <none> and password file <none>
I20260811 19:02:14.014467 17958 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:14.014514 17958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:14.014642 17958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:14.015710 17958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "05ef3a5934f74140a5778a47432f6f10"
format_stamp: "Formatted at 2026-08-11 19:02:14 on dist-test-slave-gjw7"
server_key: "028530e7f6ef544b9a3f741fa62664b2"
server_key_iv: "a159a0cb03794cb041d1f10b9f29d446"
server_key_version: "encryptionkey@0"
I20260811 19:02:14.016085 17958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "05ef3a5934f74140a5778a47432f6f10"
format_stamp: "Formatted at 2026-08-11 19:02:14 on dist-test-slave-gjw7"
server_key: "028530e7f6ef544b9a3f741fa62664b2"
server_key_iv: "a159a0cb03794cb041d1f10b9f29d446"
server_key_version: "encryptionkey@0"
I20260811 19:02:14.017393 17958 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 19:02:14.018095 17981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:14.018239 17958 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:02:14.018325 17958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "05ef3a5934f74140a5778a47432f6f10"
format_stamp: "Formatted at 2026-08-11 19:02:14 on dist-test-slave-gjw7"
server_key: "028530e7f6ef544b9a3f741fa62664b2"
server_key_iv: "a159a0cb03794cb041d1f10b9f29d446"
server_key_version: "encryptionkey@0"
I20260811 19:02:14.018392 17958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:14.021714 17958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:14.023399 17958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:14.023520 17958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:14.027436 17958 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:34057
I20260811 19:02:14.027473 18083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:34057 every 8 connection(s)
I20260811 19:02:14.027776 17958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:02:14.028726 18086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:14.030906 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 17958
I20260811 19:02:14.031002 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:02:14.030987 18086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10: Bootstrap starting.
I20260811 19:02:14.031169 6025 external_mini_cluster.cc:1428] Setting key 28af1acddcc57e61b0155e358c0c4e98
I20260811 19:02:14.031683 18086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:14.032023 18086 log.cc:824] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:14.032758 18086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10: No bootstrap required, opened a new log
I20260811 19:02:14.033694 18098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:14.031653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52507 (local address 127.5.226.126:34057)
0811 19:02:14.031888 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:14.031897 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:14.031934 (+ 37us) server_negotiation.cc:407] Connection header received
0811 19:02:14.032466 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:14.032476 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:14.032514 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:14.032659 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:14.033240 (+ 581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:14.033243 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:14.033244 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:02:14.033248 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:14.033319 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:02:14.033335 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:14.033423 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:14.033455 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 19:02:14.033495 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":75,"threads_started":1}
I20260811 19:02:14.034668 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:02:14.035449 18086 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ef3a5934f74140a5778a47432f6f10" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34057 } }
I20260811 19:02:14.035637 18086 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 19:02:14.035677 18086 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05ef3a5934f74140a5778a47432f6f10, State: Initialized, Role: FOLLOWER
I20260811 19:02:14.035805 18086 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ef3a5934f74140a5778a47432f6f10" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34057 } }
I20260811 19:02:14.035923 18086 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 19:02:14.035969 18086 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 19:02:14.036019 18086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:14.036655 18086 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ef3a5934f74140a5778a47432f6f10" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34057 } }
I20260811 19:02:14.036765 18086 leader_election.cc:302] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05ef3a5934f74140a5778a47432f6f10; no voters:
I20260811 19:02:14.036927 18086 leader_election.cc:288] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 19:02:14.036969 18112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:02:14.037123 18112 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [term 1 LEADER]: Becoming Leader. State: Replica: 05ef3a5934f74140a5778a47432f6f10, State: Running, Role: LEADER
I20260811 19:02:14.037182 18086 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:02:14.037210 18112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ef3a5934f74140a5778a47432f6f10" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34057 } }
I20260811 19:02:14.037431 18098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:14.036269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36063 (local address 127.5.226.126:34057)
0811 19:02:14.036316 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:14.036318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:14.036432 (+ 114us) server_negotiation.cc:407] Connection header received
0811 19:02:14.036457 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:14.036458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:14.036463 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:14.036530 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:14.037090 (+ 560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:14.037091 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:14.037091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 19:02:14.037097 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:14.037112 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 19:02:14.037116 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:14.037169 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:14.037356 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 19:02:14.037371 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 19:02:14.037568 18112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05ef3a5934f74140a5778a47432f6f10. Latest consensus state: current_term: 1 leader_uuid: "05ef3a5934f74140a5778a47432f6f10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ef3a5934f74140a5778a47432f6f10" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34057 } } }
I20260811 19:02:14.037643 18112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:14.037621 18114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05ef3a5934f74140a5778a47432f6f10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ef3a5934f74140a5778a47432f6f10" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 34057 } } }
I20260811 19:02:14.037835 18114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:14.038448 18124 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:02:14.038964 18124 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:02:14.040398 18124 catalog_manager.cc:1347] Generated new cluster ID: 4cf2ed103c004c1faa416db06967d8f8
I20260811 19:02:14.040441 18124 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:02:14.047367 18124 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:02:14.047534 18124 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:02:14.050954 18124 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05ef3a5934f74140a5778a47432f6f10: Generated new TSK 0
I20260811 19:02:14.051115 18124 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:02:14.055456 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 17958
2026-08-11T19:02:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1827 ms)
[----------] 18 tests from AuthTokenIssuingTest (27533 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:02:14 dist-test-slave-gjw7 krb5kdc[18150](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:02:14 dist-test-slave-gjw7 krb5kdc[18150](info): set up 2 sockets
Aug 11 19:02:14 dist-test-slave-gjw7 krb5kdc[18150](info): commencing operation
krb5kdc: starting...
W20260811 19:02:15.286831 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:02:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:02:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:02:15.404006 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:38125
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:33011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:38125,127.5.226.125:35387,127.5.226.124:45767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:02:15.486917 18177 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 19:02:15.487162 18177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:15.487181 18177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:15.487202 18177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:15.488356 18177 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:15.488400 18177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:15.488416 18177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:15.488430 18177 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:15.488449 18177 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:15.490008 18177 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:33011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:38125,127.5.226.125:35387,127.5.226.124:45767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:38125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:15.490235 18177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:15.490422 18177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:02:15.495175 18198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:15.495206 18190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:15.495298 18177 server_base.cc:1034] running on GCE node
W20260811 19:02:15.495177 18187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:15.495666 18177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:15.495967 18177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:15.497109 18177 hybrid_clock.cc:648] HybridClock initialized: now 1786474935497089 us; error 33 us; skew 500 ppm
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:15.499480 18177 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:02:15.499893 18177 webserver.cc:460] Webserver started at http://127.5.226.126:34141/ using document root <none> and password file <none>
I20260811 19:02:15.500083 18177 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:15.500126 18177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:15.500242 18177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:15.501345 18177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "33c2dcd0a90942f7aef4caf79e2e8890"
format_stamp: "Formatted at 2026-08-11 19:02:15 on dist-test-slave-gjw7"
server_key: "056e6bf9f474720e48e72835229bb65b"
server_key_iv: "f0dbe5d70c8434bd09e60d8044669fa9"
server_key_version: "encryptionkey@0"
I20260811 19:02:15.501691 18177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "33c2dcd0a90942f7aef4caf79e2e8890"
format_stamp: "Formatted at 2026-08-11 19:02:15 on dist-test-slave-gjw7"
server_key: "056e6bf9f474720e48e72835229bb65b"
server_key_iv: "f0dbe5d70c8434bd09e60d8044669fa9"
server_key_version: "encryptionkey@0"
I20260811 19:02:15.502964 18177 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 19:02:15.503623 18214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:15.503787 18177 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:02:15.503875 18177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "33c2dcd0a90942f7aef4caf79e2e8890"
format_stamp: "Formatted at 2026-08-11 19:02:15 on dist-test-slave-gjw7"
server_key: "056e6bf9f474720e48e72835229bb65b"
server_key_iv: "f0dbe5d70c8434bd09e60d8044669fa9"
server_key_version: "encryptionkey@0"
I20260811 19:02:15.503937 18177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:15.519480 18177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:15.521418 18177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:15.521548 18177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:15.525399 18177 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:38125
I20260811 19:02:15.525440 18324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:38125 every 8 connection(s)
I20260811 19:02:15.525759 18177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:02:15.526744 18327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:15.528513 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 18177
I20260811 19:02:15.528318 18327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:02:15.528630 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:02:15.528831 6025 external_mini_cluster.cc:1428] Setting key 2f4441d3de5e582462cd021f08b19c71
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:02:15.538285 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.529132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47122 (local address 127.5.226.126:38125)
0811 19:02:15.529333 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.529344 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.529417 (+ 73us) server_negotiation.cc:407] Connection header received
0811 19:02:15.529955 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.529957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.529978 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.530090 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.530585 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.531421 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.532254 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.532678 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.532786 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.535130 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.535140 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.535141 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.535149 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.536705 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.537144 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.537146 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.537147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.537230 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.537496 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.537496 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.537497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.537722 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.537786 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.538018 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.538110 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":85,"threads_started":1}
I20260811 19:02:15.538311 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.529107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:38125 (local address 127.0.0.1:47122)
0811 19:02:15.529280 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.529339 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:15.529806 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:15.530084 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:15.530086 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:15.530326 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:15.530488 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.530492 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.531506 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.531507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.532176 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.532178 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.532794 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.532795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.532861 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.533360 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:15.533368 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:15.535016 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:15.536794 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.536801 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.536803 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.537066 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.537315 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.537316 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.537316 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.537432 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.537793 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:15.537801 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:15.537882 (+ 81us) client_negotiation.cc:769] Sending connection context
0811 19:02:15.537988 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 19:02:15.538202 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":55,"thread_start_us":82,"threads_started":1}
WARNING: no policy specified for kudu/127.5.226.125@KRBTEST.COM; defaulting to no policy
I20260811 19:02:15.538991 18327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:02:15.539322 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.539215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:35387 (local address 127.0.0.1:55052)
0811 19:02:15.539259 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.539303 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:35387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 19:02:15.539471 18216 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.226.125:35387: connect: Connection refused (error 111)
I20260811 19:02:15.539870 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.539782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:35387 (local address 127.0.0.1:55056)
0811 19:02:15.539827 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.539853 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:35387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 19:02:15.539968 18327 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.125:35387: Network error: Client connection negotiation failed: client connection to 127.5.226.125:35387: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.125.keytab.
Entry for principal kudu/127.5.226.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.125.keytab.
I20260811 19:02:15.555394 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.125:35387
--webserver_interface=127.5.226.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.125.keytab
--principal=kudu/127.5.226.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:33011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:38125,127.5.226.125:35387,127.5.226.124:45767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:02:15.589205 18327 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } attempt: 1
I20260811 19:02:15.589767 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.589624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:35387 (local address 127.0.0.1:55072)
0811 19:02:15.589688 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.589733 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:35387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 19:02:15.590109 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.590034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:35387 (local address 127.0.0.1:55076)
0811 19:02:15.590069 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.590092 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:35387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 19:02:15.590195 18327 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.125:35387: Network error: Client connection negotiation failed: client connection to 127.5.226.125:35387: connect: Connection refused (error 111)
W20260811 19:02:15.637326 18338 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 19:02:15.637528 18338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:15.637543 18338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:15.637562 18338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:15.638639 18338 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:15.638674 18338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:15.638685 18338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:15.638696 18338 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:15.638712 18338 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:15.640143 18338 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:33011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:38125,127.5.226.125:35387,127.5.226.124:45767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.125.keytab
--principal=kudu/127.5.226.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.125:35387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.226.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:15.640336 18338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:15.640511 18338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:02:15.644838 18362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:15.644850 18351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:15.644894 18348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:15.645195 18338 server_base.cc:1034] running on GCE node
I20260811 19:02:15.645464 18338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:15.645747 18338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:15.646888 18338 hybrid_clock.cc:648] HybridClock initialized: now 1786474935646875 us; error 30 us; skew 500 ppm
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:15.649158 18338 init.cc:377] Logged in from keytab as kudu/127.5.226.125@KRBTEST.COM (short username kudu)
I20260811 19:02:15.649596 18338 webserver.cc:460] Webserver started at http://127.5.226.125:39969/ using document root <none> and password file <none>
I20260811 19:02:15.649808 18338 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:15.649865 18338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:15.649999 18338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:15.650986 18338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/data/instance:
uuid: "7b17ae13731f43a981b5ad2e41595a5c"
format_stamp: "Formatted at 2026-08-11 19:02:15 on dist-test-slave-gjw7"
server_key: "aa229cbe94de83e534648e7d18be936c"
server_key_iv: "c8905782942a38452c6a8e9a1433573f"
server_key_version: "encryptionkey@0"
I20260811 19:02:15.651278 18338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/wal/instance:
uuid: "7b17ae13731f43a981b5ad2e41595a5c"
format_stamp: "Formatted at 2026-08-11 19:02:15 on dist-test-slave-gjw7"
server_key: "aa229cbe94de83e534648e7d18be936c"
server_key_iv: "c8905782942a38452c6a8e9a1433573f"
server_key_version: "encryptionkey@0"
I20260811 19:02:15.652408 18338 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 19:02:15.653002 18374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:15.653153 18338 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:15.653239 18338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/wal
uuid: "7b17ae13731f43a981b5ad2e41595a5c"
format_stamp: "Formatted at 2026-08-11 19:02:15 on dist-test-slave-gjw7"
server_key: "aa229cbe94de83e534648e7d18be936c"
server_key_iv: "c8905782942a38452c6a8e9a1433573f"
server_key_version: "encryptionkey@0"
I20260811 19:02:15.653313 18338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:15.658340 18327 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } attempt: 2
I20260811 19:02:15.658720 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.658590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:35387 (local address 127.0.0.1:55086)
0811 19:02:15.658643 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.658684 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:35387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 19:02:15.659018 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.658943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:35387 (local address 127.0.0.1:55092)
0811 19:02:15.658980 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.659003 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:35387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 19:02:15.659103 18327 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.125:35387: Network error: Client connection negotiation failed: client connection to 127.5.226.125:35387: connect: Connection refused (error 111)
I20260811 19:02:15.702296 18338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:15.704167 18338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:15.704291 18338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:15.708308 18338 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.125:35387
I20260811 19:02:15.708384 18475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.125:35387 every 8 connection(s)
I20260811 19:02:15.708721 18338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/data/info.pb
I20260811 19:02:15.709748 18478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:15.710716 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 18338
I20260811 19:02:15.710803 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-1/wal/instance
I20260811 19:02:15.711004 6025 external_mini_cluster.cc:1428] Setting key 8008b694bef4a9cf1e4ea4573294b946
I20260811 19:02:15.711401 18478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.125@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.226.124@KRBTEST.COM; defaulting to no policy
I20260811 19:02:15.720734 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.712079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47138 (local address 127.5.226.126:38125)
0811 19:02:15.712143 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.712145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.712372 (+ 227us) server_negotiation.cc:407] Connection header received
0811 19:02:15.712954 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.712955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.712967 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.713034 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.713675 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.714253 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.715677 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.715882 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.715943 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.718207 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.718209 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.718209 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.718216 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.719486 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.719874 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.719876 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.719876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.719937 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.720153 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.720154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.720154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.720260 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.720317 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.720593 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.720666 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 19:02:15.720911 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.712052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:38125 (local address 127.0.0.1:47138)
0811 19:02:15.712228 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.712280 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:15.712862 (+ 582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:15.713094 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:15.713097 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:15.713391 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:15.713594 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.713600 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.714347 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.714348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.715601 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.715605 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.715980 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.715982 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.716141 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.716632 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:15.716642 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:15.718118 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:15.719559 (+ 1441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.719566 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.719568 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.719805 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.719992 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.719993 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.719993 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.720097 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.720318 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:15.720325 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:15.720458 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 19:02:15.720564 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 19:02:15.720710 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
I20260811 19:02:15.721417 18478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.124@KRBTEST.COM" created.
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.125@KRBTEST.COM for kudu/127.5.226.125@KRBTEST.COM
I20260811 19:02:15.728549 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.721660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:35387 (local address 127.0.0.1:55108)
0811 19:02:15.721709 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.721721 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:15.721765 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:15.721999 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:15.722000 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:15.722136 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:15.722192 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.722194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.723275 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.723276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.723767 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.723768 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.724211 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.724212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.724272 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.724633 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:15.724637 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:15.725972 (+ 1335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:15.727527 (+ 1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.727528 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.727528 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.727729 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.727913 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.727914 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.727915 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.727980 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.728210 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:15.728211 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:15.728259 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 19:02:15.728323 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 19:02:15.728430 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 19:02:15.728560 18488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.721729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55108 (local address 127.5.226.125:35387)
0811 19:02:15.721878 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.721882 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.721897 (+ 15us) server_negotiation.cc:407] Connection header received
0811 19:02:15.721916 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.721917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.721928 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.721986 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.722254 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.723177 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.723843 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.724147 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.724206 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.726054 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.726065 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.726065 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.726073 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.727443 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.727800 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.727802 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.727802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.727849 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.728037 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.728037 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.728037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.728157 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.728209 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.728356 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.728475 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260811 19:02:15.729179 18478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:02:15.729537 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.729446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:45767 (local address 127.0.0.1:51546)
0811 19:02:15.729479 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.729519 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260811 19:02:15.729663 18375 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
I20260811 19:02:15.730051 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.729972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:45767 (local address 127.0.0.1:51548)
0811 19:02:15.730013 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.730036 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 19:02:15.730151 18478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:45767: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.124.keytab.
Entry for principal kudu/127.5.226.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.124.keytab.
I20260811 19:02:15.737843 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.124:45767
--webserver_interface=127.5.226.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.124.keytab
--principal=kudu/127.5.226.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:33011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:38125,127.5.226.125:35387,127.5.226.124:45767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:02:15.750250 18327 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } attempt: 3
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for kudu/127.5.226.125@KRBTEST.COM
I20260811 19:02:15.757042 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.750602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:35387 (local address 127.0.0.1:55112)
0811 19:02:15.750674 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.750687 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:15.750745 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:15.750872 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:15.750873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:15.751015 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:15.751083 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.751084 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.751991 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.751992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.752511 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.752512 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.752998 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.752998 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.753048 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.753481 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:15.753486 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:15.754596 (+ 1110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:15.756146 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.756147 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.756147 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.756313 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.756500 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.756501 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.756501 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.756551 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.756788 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:15.756788 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:15.756830 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 19:02:15.756898 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 19:02:15.756976 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 19:02:15.757089 18488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.750661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55112 (local address 127.5.226.125:35387)
0811 19:02:15.750730 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.750732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.750744 (+ 12us) server_negotiation.cc:407] Connection header received
0811 19:02:15.750796 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.750798 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.750811 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.750867 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.751139 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.751920 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.752583 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.752935 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.753004 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.754669 (+ 1665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.754671 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.754671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.754679 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.756073 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.756386 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.756387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.756388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.756445 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.756612 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.756612 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.756613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.756735 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.756799 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.756931 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.757007 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 19:02:15.757438 18327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:02:15.757736 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.757649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:45767 (local address 127.0.0.1:51558)
0811 19:02:15.757688 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.757713 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 19:02:15.758010 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.757959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:45767 (local address 127.0.0.1:51564)
0811 19:02:15.757979 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.757998 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260811 19:02:15.758091 18327 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:45767: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
I20260811 19:02:15.779376 18478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } attempt: 1
I20260811 19:02:15.779812 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.779703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:45767 (local address 127.0.0.1:51576)
0811 19:02:15.779753 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.779785 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 19:02:15.780105 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.780033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:45767 (local address 127.0.0.1:51580)
0811 19:02:15.780066 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.780089 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 19:02:15.780187 18478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:45767: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
I20260811 19:02:15.789258 18327 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } attempt: 1
I20260811 19:02:15.789717 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.789596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:45767 (local address 127.0.0.1:51594)
0811 19:02:15.789650 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.789688 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 19:02:15.790025 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.789957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:45767 (local address 127.0.0.1:51604)
0811 19:02:15.789988 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.790009 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 19:02:15.790112 18327 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:45767: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
W20260811 19:02:15.821492 18494 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 19:02:15.821702 18494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:15.821718 18494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:15.821735 18494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:15.822806 18494 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:15.822839 18494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:15.822851 18494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:15.822871 18494 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:15.822887 18494 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:15.824329 18494 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:33011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:38125,127.5.226.125:35387,127.5.226.124:45767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.124.keytab
--principal=kudu/127.5.226.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.124:45767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.226.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:15.824537 18494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:15.824723 18494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:02:15.829521 18504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:15.829521 18500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:15.829512 18502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:15.829579 18494 server_base.cc:1034] running on GCE node
I20260811 19:02:15.829952 18494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:15.830284 18494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:15.831425 18494 hybrid_clock.cc:648] HybridClock initialized: now 1786474935831409 us; error 37 us; skew 500 ppm
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:15.833993 18494 init.cc:377] Logged in from keytab as kudu/127.5.226.124@KRBTEST.COM (short username kudu)
I20260811 19:02:15.834439 18494 webserver.cc:460] Webserver started at http://127.5.226.124:33759/ using document root <none> and password file <none>
I20260811 19:02:15.834654 18494 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:15.834702 18494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:15.834837 18494 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:15.835950 18494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/data/instance:
uuid: "2492daa01aee4e73bb85e032f7c52448"
format_stamp: "Formatted at 2026-08-11 19:02:15 on dist-test-slave-gjw7"
server_key: "394096503af75f394dc41b9735268c4c"
server_key_iv: "ed2e5fc3401438464b60ea0621182fd9"
server_key_version: "encryptionkey@0"
I20260811 19:02:15.836302 18494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/wal/instance:
uuid: "2492daa01aee4e73bb85e032f7c52448"
format_stamp: "Formatted at 2026-08-11 19:02:15 on dist-test-slave-gjw7"
server_key: "394096503af75f394dc41b9735268c4c"
server_key_iv: "ed2e5fc3401438464b60ea0621182fd9"
server_key_version: "encryptionkey@0"
I20260811 19:02:15.837600 18494 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 19:02:15.838277 18517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:15.838425 18494 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:02:15.838511 18494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/wal
uuid: "2492daa01aee4e73bb85e032f7c52448"
format_stamp: "Formatted at 2026-08-11 19:02:15 on dist-test-slave-gjw7"
server_key: "394096503af75f394dc41b9735268c4c"
server_key_iv: "ed2e5fc3401438464b60ea0621182fd9"
server_key_version: "encryptionkey@0"
I20260811 19:02:15.838572 18494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:15.848321 18478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } attempt: 2
I20260811 19:02:15.848763 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.848642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:45767 (local address 127.0.0.1:51606)
0811 19:02:15.848695 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.848734 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 19:02:15.849071 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.848996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:45767 (local address 127.0.0.1:51608)
0811 19:02:15.849032 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.849054 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 19:02:15.849166 18478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:45767: Network error: Client connection negotiation failed: client connection to 127.5.226.124:45767: connect: Connection refused (error 111)
I20260811 19:02:15.853143 18494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:15.855312 18494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:15.855450 18494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:15.859416 18494 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.124:45767
I20260811 19:02:15.859449 18621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.124:45767 every 8 connection(s)
I20260811 19:02:15.859788 18494 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/data/info.pb
I20260811 19:02:15.860772 18622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:15.862386 18622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:02:15.862917 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 18494
I20260811 19:02:15.863022 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474660766540-6025-0/minicluster-data/master-2/wal/instance
I20260811 19:02:15.863224 6025 external_mini_cluster.cc:1428] Setting key 136abc7a10dd751367ee31bd1f0ca666
I20260811 19:02:15.865271 18327 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } attempt: 2
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.124@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for kudu/127.5.226.124@KRBTEST.COM
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.124@KRBTEST.COM
I20260811 19:02:15.872601 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.863090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47152 (local address 127.5.226.126:38125)
0811 19:02:15.863161 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.863163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.863342 (+ 179us) server_negotiation.cc:407] Connection header received
0811 19:02:15.863940 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.863941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.863953 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.864010 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.864731 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.865534 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.866743 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.867034 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.867102 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.869394 (+ 2292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.869395 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.869395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.869402 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.871065 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.871505 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.871506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.871507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.871565 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.871850 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.871851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.871852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.872047 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.872118 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.872428 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.872503 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 19:02:15.872815 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.865527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:45767 (local address 127.0.0.1:51628)
0811 19:02:15.865576 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.865585 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:15.865618 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:15.865919 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:15.865920 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:15.866079 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:15.866115 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.866117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.866700 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.866701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.867375 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.867377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.867725 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.867727 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.867789 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.868086 (+ 297us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:15.868090 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:15.869770 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:15.871724 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.871725 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.871726 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.871920 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.872142 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.872143 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.872143 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.872202 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.872523 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:15.872524 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:15.872567 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 19:02:15.872630 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 19:02:15.872721 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 19:02:15.873206 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.865643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51628 (local address 127.5.226.124:45767)
0811 19:02:15.865793 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.865794 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.865801 (+ 7us) server_negotiation.cc:407] Connection header received
0811 19:02:15.865818 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.865819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.865828 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.865895 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.866180 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.866631 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.867434 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.867667 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.867721 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.869847 (+ 2126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.869856 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.869857 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.869865 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.871644 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.872007 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.872010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.872011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.872068 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.872267 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.872268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.872268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.872440 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.872558 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.872715 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.873024 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":220,"server-negotiator.queue_time_us":130,"thread_start_us":90,"threads_started":1}
I20260811 19:02:15.873390 18628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.863063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:38125 (local address 127.0.0.1:47152)
0811 19:02:15.863226 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.863268 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:15.863838 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:15.864033 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:15.864036 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:15.864395 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:15.864640 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.864646 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.865608 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.865609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.866675 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.866678 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.867132 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.867133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.867249 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.867807 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:15.867818 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:15.869322 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:15.871139 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.871146 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.871148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.871423 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.871645 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.871646 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.871646 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.871774 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.872110 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:15.872116 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:15.872276 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 19:02:15.872386 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 19:02:15.872958 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
I20260811 19:02:15.873993 18622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:02:15.874459 18631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.863571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51618 (local address 127.5.226.124:45767)
0811 19:02:15.863873 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.863876 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.863910 (+ 34us) server_negotiation.cc:407] Connection header received
0811 19:02:15.863990 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.863992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.864012 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.864088 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.864733 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.865936 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.866901 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.867265 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.867332 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.871165 (+ 3833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.871166 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.871166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.871173 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.872619 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.873156 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.873157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.873157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.873216 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.873835 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.873836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.873836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.873965 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.874095 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.874260 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.874337 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":62,"threads_started":1}
I20260811 19:02:15.875068 18327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890: Bootstrap starting.
I20260811 19:02:15.875939 18327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:15.876214 18327 log.cc:824] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:15.877110 18327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890: No bootstrap required, opened a new log
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.124@KRBTEST.COM for kudu/127.5.226.125@KRBTEST.COM
I20260811 19:02:15.879189 18327 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } }
I20260811 19:02:15.879338 18327 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33c2dcd0a90942f7aef4caf79e2e8890, State: Initialized, Role: FOLLOWER
I20260811 19:02:15.879421 18327 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } }
I20260811 19:02:15.879758 18327 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:02:15.879751 18635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } } }
I20260811 19:02:15.879868 18635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:02:15.880625 18488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.874331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55128 (local address 127.5.226.125:35387)
0811 19:02:15.874385 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.874387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.874397 (+ 10us) server_negotiation.cc:407] Connection header received
0811 19:02:15.874420 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.874421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.874430 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.874481 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.874742 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.875369 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.876027 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.876241 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.876294 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.877943 (+ 1649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.877945 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.877945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.877953 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.879361 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.879744 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.879746 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.879746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.879808 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.880038 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.880039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.880040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.880186 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.880241 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.880444 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.880528 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 19:02:15.880880 18628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.874225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:35387 (local address 127.0.0.1:55128)
0811 19:02:15.874320 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.874330 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:15.874365 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:15.874492 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:15.874493 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:15.874622 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:15.874666 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.874667 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.875437 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.875438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.875952 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.875953 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.876298 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.876299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.876364 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.876712 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:15.876716 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:15.877866 (+ 1150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:15.879446 (+ 1580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.879447 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.879447 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.879653 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.879896 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.879897 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.879897 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.879960 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.880268 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:15.880269 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:15.880315 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 19:02:15.880692 (+ 377us) client_negotiation.cc:240] Negotiation successful
0811 19:02:15.880781 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 19:02:15.881227 18622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } has no permanent_uuid. Determining permanent_uuid...
W20260811 19:02:15.881825 18652 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:02:15.881884 18652 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:02:15.884966 18177 master_runner.cc:186] Error getting master registration for 127.5.226.125:35387: OK, instance_id { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" instance_seqno: 1786474935707195 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 19:02:15.887827 18177 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.124@KRBTEST.COM for kudu/127.5.226.124@KRBTEST.COM
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:02:15.891360 18628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.881492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:45767 (local address 127.0.0.1:51632)
0811 19:02:15.881557 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.881566 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:15.881600 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:15.881833 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:15.881834 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:15.882030 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:15.882067 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.882069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.885145 (+ 3076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.885146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.885941 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.885944 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.886444 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.886445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.886488 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.886890 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:15.886895 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:15.888332 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:15.890048 (+ 1716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.890048 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.890049 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.890242 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.890419 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.890419 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.890419 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.890468 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.891014 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:15.891015 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:15.891059 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 19:02:15.891134 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 19:02:15.891233 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 19:02:15.891434 18631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.881655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51632 (local address 127.5.226.124:45767)
0811 19:02:15.881715 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.881716 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.881725 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:02:15.881745 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.881746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.881771 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.881826 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.882135 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.885062 (+ 2927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.886059 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.886345 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.886403 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.888417 (+ 2014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.888418 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.888419 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.888425 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.889934 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.890311 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.890312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.890312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.890362 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.890536 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.890538 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.890538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.890939 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.891012 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.891168 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.891290 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":38}
I20260811 19:02:15.892573 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.876682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47160 (local address 127.5.226.126:38125)
0811 19:02:15.876715 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.876717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.876724 (+ 7us) server_negotiation.cc:407] Connection header received
0811 19:02:15.876803 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.876805 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.876815 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.876874 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.877507 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.878140 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.884472 (+ 6332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.884725 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.884767 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.890048 (+ 5281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.890049 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.890050 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.890057 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.891489 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.891864 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.891866 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.891866 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.891922 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.892114 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.892115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.892115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.892220 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.892349 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.892423 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.892493 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 19:02:15.892650 18622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448: Bootstrap starting.
I20260811 19:02:15.893421 18622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:15.893671 18622 log.cc:824] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:15.894356 18622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448: No bootstrap required, opened a new log
I20260811 19:02:15.896307 18622 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } }
I20260811 19:02:15.896466 18622 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2492daa01aee4e73bb85e032f7c52448, State: Initialized, Role: FOLLOWER
I20260811 19:02:15.896562 18622 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } }
I20260811 19:02:15.896926 18622 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:02:15.896884 18660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } } }
I20260811 19:02:15.896996 18660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448 [sys.catalog]: This master's current role is: FOLLOWER
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.125@KRBTEST.COM
W20260811 19:02:15.898910 18681 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:02:15.898962 18681 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:02:15.900640 18494 master_runner.cc:186] Error getting master registration for 127.5.226.125:35387: OK, instance_id { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" instance_seqno: 1786474935707195 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 19:02:15.902848 18494 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 19:02:15.903023 18488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.893149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55130 (local address 127.5.226.125:35387)
0811 19:02:15.893195 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.893197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.893206 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:02:15.893229 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.893230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.893239 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.893326 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.893792 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.894507 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.895415 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.895713 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.895777 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.899046 (+ 3269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.899048 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.899048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.899057 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.901706 (+ 2649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.902100 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.902101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.902101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.902160 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.902372 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.902373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.902373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.902503 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.902633 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.902847 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.902929 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 19:02:15.904801 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:02:15.905834 18270 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "33c2dcd0a90942f7aef4caf79e2e8890"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47160
I20260811 19:02:15.905987 18270 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 19:02:15.906045 18270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:15.907122 18270 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } }
I20260811 19:02:15.907377 18270 leader_election.cc:288] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [CANDIDATE]: Term 1 election: Requested vote from peers 7b17ae13731f43a981b5ad2e41595a5c (127.5.226.125:35387), 2492daa01aee4e73bb85e032f7c52448 (127.5.226.124:45767)
I20260811 19:02:15.907629 18573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2492daa01aee4e73bb85e032f7c52448"
I20260811 19:02:15.907732 18573 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:15.908600 18573 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2dcd0a90942f7aef4caf79e2e8890 in term 1.
I20260811 19:02:15.908810 18216 leader_election.cc:302] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2492daa01aee4e73bb85e032f7c52448, 33c2dcd0a90942f7aef4caf79e2e8890; no voters:
I20260811 19:02:15.908946 18635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:02:15.909127 18635 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [term 1 LEADER]: Becoming Leader. State: Replica: 33c2dcd0a90942f7aef4caf79e2e8890, State: Running, Role: LEADER
I20260811 19:02:15.909229 18635 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } }
I20260811 19:02:15.909706 18635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33c2dcd0a90942f7aef4caf79e2e8890. Latest consensus state: current_term: 1 leader_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } } }
I20260811 19:02:15.909792 18635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:15.917436 18692 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:02:15.917663 18692 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:02:15.918838 18488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.909380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55138 (local address 127.5.226.125:35387)
0811 19:02:15.909416 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.909418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.910103 (+ 685us) server_negotiation.cc:407] Connection header received
0811 19:02:15.910195 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.910196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.910206 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.910234 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.910973 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.911726 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.912770 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.913071 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.913131 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.915393 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.915395 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.915395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.915402 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.917046 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.917705 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.917707 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.917707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.917767 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.918128 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.918129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.918129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.918274 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.918355 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.918649 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.918735 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 19:02:15.923372 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.909754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47176 (local address 127.5.226.126:38125)
0811 19:02:15.909790 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.909792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.911049 (+ 1257us) server_negotiation.cc:407] Connection header received
0811 19:02:15.911136 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.911137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.911146 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.911174 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.912802 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.913501 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.915306 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.915600 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.915639 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.919826 (+ 4187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.919827 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.919828 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.919835 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.921607 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.922304 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.922305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.922306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.922377 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.922667 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.922668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.922669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.922808 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.922876 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.923184 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.923268 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 19:02:15.925606 18631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.909581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51644 (local address 127.5.226.124:45767)
0811 19:02:15.909616 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.909617 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.914568 (+ 4951us) server_negotiation.cc:407] Connection header received
0811 19:02:15.914660 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.914661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.914672 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.914700 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.916123 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.917072 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.918963 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.919243 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.919281 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.922650 (+ 3369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.922652 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.922652 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.922659 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.924262 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.924718 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.924719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.924720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.924774 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.924983 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.924984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.924985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.925128 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.925223 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.925430 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.925514 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 19:02:15.930235 18573 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448 [term 1 FOLLOWER]: Refusing update from remote peer 33c2dcd0a90942f7aef4caf79e2e8890: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:02:15.930580 18635 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:02:15.932057 18660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33c2dcd0a90942f7aef4caf79e2e8890. Latest consensus state: current_term: 1 leader_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } } }
I20260811 19:02:15.932147 18660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:02:15.933261 18635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } } }
I20260811 19:02:15.933379 18635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:15.933395 18660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } } }
I20260811 19:02:15.933473 18660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:02:15.933684 18698 mvcc.cc:205] Tried to move back new op lower bound from 7317401337567420416 to 7317401337484996608. Current Snapshot: MvccSnapshot[applied={T|T < 7317401337567420416}]
I20260811 19:02:15.936641 18692 catalog_manager.cc:1347] Generated new cluster ID: 079e80da20c14944978254d51e462ed1
I20260811 19:02:15.936695 18692 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:02:15.940318 18478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } attempt: 3
Aug 11 19:02:15 dist-test-slave-gjw7 krb5kdc[18150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474935, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.125@KRBTEST.COM for kudu/127.5.226.124@KRBTEST.COM
I20260811 19:02:15.948230 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.940571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:45767 (local address 127.0.0.1:51650)
0811 19:02:15.940619 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:15.940633 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:15.940687 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:15.940808 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:15.940809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:15.940997 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:15.941048 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.941050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.941984 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.941986 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.942787 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:15.942790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.943275 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.943276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:15.943331 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.943780 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:15.943786 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:15.945412 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:15.947153 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.947154 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.947155 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.947386 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.947594 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:15.947595 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:15.947596 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:15.947659 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:15.947925 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:15.947926 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:15.947972 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 19:02:15.948031 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 19:02:15.948128 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 19:02:15.948581 18631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:15.940659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51650 (local address 127.5.226.124:45767)
0811 19:02:15.940695 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.940697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.940707 (+ 10us) server_negotiation.cc:407] Connection header received
0811 19:02:15.940731 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.940732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.940741 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.940803 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.941134 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.941892 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.942878 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:15.943167 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:15.943222 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:15.945499 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:15.945500 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:15.945501 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:15.945508 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:15.947076 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.947460 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.947461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.947462 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.947521 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:15.947720 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:15.947721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:15.947721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:15.947842 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:15.947899 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:15.948420 (+ 521us) server_negotiation.cc:299] Negotiation successful
0811 19:02:15.948496 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 19:02:15.950110 18478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c: Bootstrap starting.
I20260811 19:02:15.950840 18478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:15.951143 18478 log.cc:824] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:15.952150 18478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c: No bootstrap required, opened a new log
I20260811 19:02:15.954198 18692 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:02:15.954176 18478 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } }
I20260811 19:02:15.954308 18478 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b17ae13731f43a981b5ad2e41595a5c, State: Initialized, Role: FOLLOWER
I20260811 19:02:15.954393 18478 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } }
I20260811 19:02:15.954708 18478 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c [sys.catalog]: configured and running, proceeding with master startup.
W20260811 19:02:15.954874 18381 tablet.cc:2369] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:02:15.954882 18692 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:02:15.955091 18422 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:15.956032 18422 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c [term 1 FOLLOWER]: Refusing update from remote peer 33c2dcd0a90942f7aef4caf79e2e8890: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:02:15.956200 18424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7b17ae13731f43a981b5ad2e41595a5c"
I20260811 19:02:15.956943 18424 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2dcd0a90942f7aef4caf79e2e8890 in term 1.
I20260811 19:02:15.957466 18635 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:02:15.959308 18692 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890: Generated new TSK 0
I20260811 19:02:15.959482 18692 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 19:02:15.962136 18744 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:02:15.962188 18744 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:02:15.963128 18716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } } }
I20260811 19:02:15.963304 18716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:02:15.963310 18687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } } }
I20260811 19:02:15.963418 18687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33c2dcd0a90942f7aef4caf79e2e8890 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:15.963405 18716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33c2dcd0a90942f7aef4caf79e2e8890. Latest consensus state: current_term: 1 leader_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } } }
I20260811 19:02:15.963567 18716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:02:15.963634 18716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33c2dcd0a90942f7aef4caf79e2e8890" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 38125 } } peers { permanent_uuid: "7b17ae13731f43a981b5ad2e41595a5c" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 35387 } } peers { permanent_uuid: "2492daa01aee4e73bb85e032f7c52448" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 45767 } } }
I20260811 19:02:15.964207 18716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:02:15.964149 18709 mvcc.cc:205] Tried to move back new op lower bound from 7317401337662255104 to 7317401337484996608. Current Snapshot: MvccSnapshot[applied={T|T < 7317401337567420416}]
W20260811 19:02:15.990788 18331 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:15.989651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47180 (local address 127.5.226.126:38125)
0811 19:02:15.989697 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.989700 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.990057 (+ 357us) server_negotiation.cc:407] Connection header received
0811 19:02:15.990165 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.990167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.990179 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.990209 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.990710 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47180: BlockingRecv error: recv got EOF from 127.0.0.1:47180 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 19:02:15.992103 18488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:15.991179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55150 (local address 127.5.226.125:35387)
0811 19:02:15.991222 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.991224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.991556 (+ 332us) server_negotiation.cc:407] Connection header received
0811 19:02:15.991655 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.991656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.991667 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.991696 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.992040 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55150: BlockingRecv error: recv got EOF from 127.0.0.1:55150 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 19:02:15.992882 18631 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:15.991433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51664 (local address 127.5.226.124:45767)
0811 19:02:15.991473 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.991475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.992389 (+ 914us) server_negotiation.cc:407] Connection header received
0811 19:02:15.992486 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.992487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.992497 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.992526 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.992824 (+ 298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51664: BlockingRecv error: recv got EOF from 127.0.0.1:51664 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 19:02:15.995205 18488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:15.994412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55166 (local address 127.5.226.125:35387)
0811 19:02:15.994443 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.994444 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.994684 (+ 240us) server_negotiation.cc:407] Connection header received
0811 19:02:15.994789 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.994790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.994808 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.994838 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.995162 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55166: BlockingRecv error: recv got EOF from 127.0.0.1:55166 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 19:02:15.998172 18488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:15.997453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55174 (local address 127.5.226.125:35387)
0811 19:02:15.997485 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:15.997487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:15.997698 (+ 211us) server_negotiation.cc:407] Connection header received
0811 19:02:15.997787 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:15.997788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:15.997798 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:15.997826 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:15.998129 (+ 303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55174: BlockingRecv error: recv got EOF from 127.0.0.1:55174 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 19:02:16.002071 18488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:16.001282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55182 (local address 127.5.226.125:35387)
0811 19:02:16.001377 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:16.001379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:16.001601 (+ 222us) server_negotiation.cc:407] Connection header received
0811 19:02:16.001688 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:16.001689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:16.001699 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:16.001725 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:16.002029 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55182: BlockingRecv error: recv got EOF from 127.0.0.1:55182 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260811 19:02:16.008064 18488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:16.007295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55192 (local address 127.5.226.125:35387)
0811 19:02:16.007331 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:16.007333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:16.007554 (+ 221us) server_negotiation.cc:407] Connection header received
0811 19:02:16.007647 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:16.007649 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:16.007660 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:16.007691 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:16.008018 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55192: BlockingRecv error: recv got EOF from 127.0.0.1:55192 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 19:02:16.018265 18488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:16.017375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55204 (local address 127.5.226.125:35387)
0811 19:02:16.017420 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:16.017423 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:16.017682 (+ 259us) server_negotiation.cc:407] Connection header received
0811 19:02:16.017781 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:16.017783 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:16.017794 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:16.017822 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:16.018196 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55204: BlockingRecv error: recv got EOF from 127.0.0.1:55204 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 19:02:16.036712 18488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:16.035746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55212 (local address 127.5.226.125:35387)
0811 19:02:16.035789 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:16.035791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:16.036087 (+ 296us) server_negotiation.cc:407] Connection header received
0811 19:02:16.036192 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:16.036193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:16.036205 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:16.036233 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:16.036650 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55212: BlockingRecv error: recv got EOF from 127.0.0.1:55212 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 19:02:16.070750 18488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:16.070028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55220 (local address 127.5.226.125:35387)
0811 19:02:16.070073 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:16.070075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:16.070212 (+ 137us) server_negotiation.cc:407] Connection header received
0811 19:02:16.070280 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:16.070280 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:16.070293 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:16.070335 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:16.070686 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55220: BlockingRecv error: recv got EOF from 127.0.0.1:55220 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 19:02:16.136418 18488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:16.135783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55234 (local address 127.5.226.125:35387)
0811 19:02:16.135852 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:16.135854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:16.135949 (+ 95us) server_negotiation.cc:407] Connection header received
0811 19:02:16.135997 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:16.135998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:16.136008 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:16.136072 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:16.136367 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55234: BlockingRecv error: recv got EOF from 127.0.0.1:55234 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 19:02:16.266233 18488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:16.265553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55236 (local address 127.5.226.125:35387)
0811 19:02:16.265619 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:16.265622 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:16.265697 (+ 75us) server_negotiation.cc:407] Connection header received
0811 19:02:16.265772 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:16.265773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:16.265784 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:16.265833 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:16.266168 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55236: BlockingRecv error: recv got EOF from 127.0.0.1:55236 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260811 19:02:16.523958 18488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:16.523375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55244 (local address 127.5.226.125:35387)
0811 19:02:16.523424 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:16.523426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:16.523464 (+ 38us) server_negotiation.cc:407] Connection header received
0811 19:02:16.523533 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:16.523534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:16.523543 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:16.523601 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:16.523899 (+ 298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55244: BlockingRecv error: recv got EOF from 127.0.0.1:55244 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 19:02:16.899405 18681 catalog_manager.cc:1259] Loaded cluster ID: 079e80da20c14944978254d51e462ed1
I20260811 19:02:16.899478 18681 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448: loading cluster ID for follower catalog manager: success
I20260811 19:02:16.900230 18681 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448: acquiring CA information for follower catalog manager: success
I20260811 19:02:16.900489 18681 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2492daa01aee4e73bb85e032f7c52448: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 19:02:16.962585 18744 catalog_manager.cc:1259] Loaded cluster ID: 079e80da20c14944978254d51e462ed1
I20260811 19:02:16.962661 18744 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c: loading cluster ID for follower catalog manager: success
I20260811 19:02:16.963410 18744 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c: acquiring CA information for follower catalog manager: success
I20260811 19:02:16.963661 18744 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7b17ae13731f43a981b5ad2e41595a5c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 19:02:17.039605 18883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:17.037110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55258 (local address 127.5.226.125:35387)
0811 19:02:17.037227 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:17.037229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:17.037242 (+ 13us) server_negotiation.cc:407] Connection header received
0811 19:02:17.037350 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:17.037351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:17.037408 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:17.037478 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:02:17.037620 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:17.038124 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:17.038871 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:17.039064 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:17.039119 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:17.039273 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:02:17.039389 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:02:17.039457 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:17.039495 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 19:02:17.039517 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":59,"threads_started":1}
I20260811 19:02:17.043776 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:17.041379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51676 (local address 127.5.226.124:45767)
0811 19:02:17.041489 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:17.041491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:17.041500 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:02:17.041563 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:17.041564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:17.041613 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:17.041679 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:02:17.041771 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:17.042338 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:17.043029 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:17.043242 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:17.043294 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:17.043449 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:02:17.043560 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:02:17.043624 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:17.043667 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 19:02:17.043689 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":61,"threads_started":1}
I20260811 19:02:17.048164 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:17.045223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47194 (local address 127.5.226.126:38125)
0811 19:02:17.045344 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:17.045346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:17.045477 (+ 131us) server_negotiation.cc:407] Connection header received
0811 19:02:17.045526 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:17.045527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:17.045576 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:17.045670 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:02:17.045797 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:17.046558 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:17.047318 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:17.047548 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:17.047733 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:17.047809 (+ 76us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:02:17.047922 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:02:17.048010 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:17.048057 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 19:02:17.048082 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":54,"threads_started":1}
I20260811 19:02:17.048183 18883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:17.045260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55274 (local address 127.5.226.125:35387)
0811 19:02:17.045322 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:17.045324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:17.045672 (+ 348us) server_negotiation.cc:407] Connection header received
0811 19:02:17.045764 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:17.045765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:17.045776 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:17.045819 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:02:17.045984 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:17.046448 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:17.047472 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:17.047739 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:17.047801 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:17.047940 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:02:17.047970 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:02:17.048011 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:17.048104 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 19:02:17.048126 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 19:02:17.048282 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:17.045523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51682 (local address 127.5.226.124:45767)
0811 19:02:17.045554 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:17.045556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:17.045721 (+ 165us) server_negotiation.cc:407] Connection header received
0811 19:02:17.045742 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:17.045743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:17.045753 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:17.045797 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:02:17.045948 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:17.046633 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:17.047580 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:17.047781 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:17.047837 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:17.047979 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:02:17.048011 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:02:17.048055 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:17.048190 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 19:02:17.048213 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260811 19:02:17.049962 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 18177
I20260811 19:02:17.067430 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 18338
I20260811 19:02:17.083774 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 18494
2026-08-11T19:02:17Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3026 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:02:17 dist-test-slave-gjw7 krb5kdc[18916](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:02:17 dist-test-slave-gjw7 krb5kdc[18916](info): set up 2 sockets
Aug 11 19:02:17 dist-test-slave-gjw7 krb5kdc[18916](info): commencing operation
krb5kdc: starting...
W20260811 19:02:18.335613 6025 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/test-user.keytab.
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:02:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:02:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.226.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
Entry for principal kudu/127.5.226.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab.
I20260811 19:02:18.457626 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:36811
--webserver_interface=127.5.226.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:46845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:36811,127.5.226.125:45041,127.5.226.124:37895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:02:18.539438 18946 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 19:02:18.539659 18946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:18.539674 18946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:18.539692 18946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:18.540768 18946 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:18.540802 18946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:18.540815 18946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:18.540827 18946 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:18.540840 18946 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:18.542372 18946 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:46845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:36811,127.5.226.125:45041,127.5.226.124:37895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.126.keytab
--principal=kudu/127.5.226.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.126:36811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.226.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:18.542574 18946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:18.542750 18946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:02:18.548307 18954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:18.548316 18955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:18.548399 18957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:18.548343 18946 server_base.cc:1034] running on GCE node
I20260811 19:02:18.548954 18946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:18.549399 18946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:18.550545 18946 hybrid_clock.cc:648] HybridClock initialized: now 1786474938550525 us; error 37 us; skew 500 ppm
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:18.552944 18946 init.cc:377] Logged in from keytab as kudu/127.5.226.126@KRBTEST.COM (short username kudu)
I20260811 19:02:18.553411 18946 webserver.cc:460] Webserver started at http://127.5.226.126:37933/ using document root <none> and password file <none>
I20260811 19:02:18.553614 18946 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:18.553663 18946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:18.553784 18946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:18.554857 18946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/data/instance:
uuid: "51eaa019823a47eb87e84ea1f3fce688"
format_stamp: "Formatted at 2026-08-11 19:02:18 on dist-test-slave-gjw7"
server_key: "fb699cfa952ef0652b6ce89745c3898a"
server_key_iv: "39ea98ae0e945018c5bdd2ab8f89dd7e"
server_key_version: "encryptionkey@0"
I20260811 19:02:18.555209 18946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/wal/instance:
uuid: "51eaa019823a47eb87e84ea1f3fce688"
format_stamp: "Formatted at 2026-08-11 19:02:18 on dist-test-slave-gjw7"
server_key: "fb699cfa952ef0652b6ce89745c3898a"
server_key_iv: "39ea98ae0e945018c5bdd2ab8f89dd7e"
server_key_version: "encryptionkey@0"
I20260811 19:02:18.556493 18946 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 19:02:18.557117 18980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:18.557268 18946 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 19:02:18.557375 18946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/wal
uuid: "51eaa019823a47eb87e84ea1f3fce688"
format_stamp: "Formatted at 2026-08-11 19:02:18 on dist-test-slave-gjw7"
server_key: "fb699cfa952ef0652b6ce89745c3898a"
server_key_iv: "39ea98ae0e945018c5bdd2ab8f89dd7e"
server_key_version: "encryptionkey@0"
I20260811 19:02:18.557435 18946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:18.581004 18946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:18.582924 18946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:18.583040 18946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:18.586886 18946 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.126:36811
I20260811 19:02:18.586915 19083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.126:36811 every 8 connection(s)
I20260811 19:02:18.587248 18946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/data/info.pb
I20260811 19:02:18.588203 19084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:18.589792 19084 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:02:18.592983 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 18946
I20260811 19:02:18.593071 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-0/wal/instance
I20260811 19:02:18.593248 6025 external_mini_cluster.cc:1428] Setting key d143b6d0bf04da4f0146c2bd6fe9a3a0
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:02:18.599110 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.590417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:36811 (local address 127.0.0.1:52594)
0811 19:02:18.590578 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.590616 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:18.591054 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:18.591281 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:18.591283 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:18.591553 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:18.591710 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.591715 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.592654 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.592655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.593536 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.593540 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.594133 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.594134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.594184 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.594631 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:18.594639 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:18.595971 (+ 1332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:18.597721 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.597729 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.597731 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.597930 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.598211 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.598211 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.598211 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.598295 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.598691 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:18.598695 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:18.598746 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 19:02:18.598810 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 19:02:18.598937 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
I20260811 19:02:18.599121 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.590581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52594 (local address 127.5.226.126:36811)
0811 19:02:18.590687 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.590690 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.590718 (+ 28us) server_negotiation.cc:407] Connection header received
0811 19:02:18.591175 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.591177 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.591193 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.591266 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.591778 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.592586 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.593614 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.594043 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.594153 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.596053 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.596062 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.596062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.596068 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.597640 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.598021 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.598024 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.598025 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.598139 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.598349 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.598350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.598350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.598629 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.598716 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.598878 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.599022 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":78,"thread_start_us":41,"threads_started":1}
I20260811 19:02:18.599953 19084 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:02:18.600243 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.600147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45041 (local address 127.0.0.1:41120)
0811 19:02:18.600188 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.600226 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:45041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 19:02:18.600382 18983 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.226.125:45041: connect: Connection refused (error 111)
I20260811 19:02:18.600786 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.600707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45041 (local address 127.0.0.1:41128)
0811 19:02:18.600747 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.600771 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:45041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 19:02:18.600911 19084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.125:45041: Network error: Client connection negotiation failed: client connection to 127.5.226.125:45041: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.5.226.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.125.keytab.
Entry for principal kudu/127.5.226.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.125.keytab.
I20260811 19:02:18.618258 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.125:45041
--webserver_interface=127.5.226.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.125.keytab
--principal=kudu/127.5.226.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:46845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:36811,127.5.226.125:45041,127.5.226.124:37895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:02:18.650105 19084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } attempt: 1
I20260811 19:02:18.650583 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.650454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45041 (local address 127.0.0.1:41142)
0811 19:02:18.650507 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.650552 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:45041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 19:02:18.650940 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.650856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45041 (local address 127.0.0.1:41144)
0811 19:02:18.650897 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.650922 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:45041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 19:02:18.651016 19084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.125:45041: Network error: Client connection negotiation failed: client connection to 127.5.226.125:45041: connect: Connection refused (error 111)
W20260811 19:02:18.698786 19102 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 19:02:18.698995 19102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:18.699020 19102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:18.699045 19102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:18.700160 19102 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:18.700201 19102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:18.700220 19102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:18.700235 19102 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:18.700249 19102 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:18.701723 19102 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:46845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:36811,127.5.226.125:45041,127.5.226.124:37895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.125.keytab
--principal=kudu/127.5.226.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.125:45041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.226.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:18.701963 19102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:18.702165 19102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:02:18.706696 19112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:02:18.706660 19111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:18.706733 19102 server_base.cc:1034] running on GCE node
W20260811 19:02:18.706661 19115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:18.707125 19102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:18.707393 19102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:18.708527 19102 hybrid_clock.cc:648] HybridClock initialized: now 1786474938708519 us; error 26 us; skew 500 ppm
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:18.710880 19102 init.cc:377] Logged in from keytab as kudu/127.5.226.125@KRBTEST.COM (short username kudu)
I20260811 19:02:18.711274 19102 webserver.cc:460] Webserver started at http://127.5.226.125:36189/ using document root <none> and password file <none>
I20260811 19:02:18.711491 19102 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:18.711540 19102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:18.711666 19102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:18.712733 19102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/data/instance:
uuid: "f7f87134bc0643e4a4d386a82c09eaf8"
format_stamp: "Formatted at 2026-08-11 19:02:18 on dist-test-slave-gjw7"
server_key: "1980dcee887e2e412e7c6325d64c1b44"
server_key_iv: "af5931bcb4072683bb95e696ac8b56c3"
server_key_version: "encryptionkey@0"
I20260811 19:02:18.713060 19102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/wal/instance:
uuid: "f7f87134bc0643e4a4d386a82c09eaf8"
format_stamp: "Formatted at 2026-08-11 19:02:18 on dist-test-slave-gjw7"
server_key: "1980dcee887e2e412e7c6325d64c1b44"
server_key_iv: "af5931bcb4072683bb95e696ac8b56c3"
server_key_version: "encryptionkey@0"
I20260811 19:02:18.714372 19102 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 19:02:18.715101 19128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:18.715250 19102 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:02:18.715325 19102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/wal
uuid: "f7f87134bc0643e4a4d386a82c09eaf8"
format_stamp: "Formatted at 2026-08-11 19:02:18 on dist-test-slave-gjw7"
server_key: "1980dcee887e2e412e7c6325d64c1b44"
server_key_iv: "af5931bcb4072683bb95e696ac8b56c3"
server_key_version: "encryptionkey@0"
I20260811 19:02:18.715411 19102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:18.719146 19084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } attempt: 2
I20260811 19:02:18.719537 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.719400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45041 (local address 127.0.0.1:41150)
0811 19:02:18.719460 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.719500 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:45041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 19:02:18.719828 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.719762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45041 (local address 127.0.0.1:41160)
0811 19:02:18.719793 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.719813 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.125:45041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260811 19:02:18.719909 19084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.125:45041: Network error: Client connection negotiation failed: client connection to 127.5.226.125:45041: connect: Connection refused (error 111)
I20260811 19:02:18.722849 19102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:18.724624 19102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:18.724730 19102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:18.728451 19102 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.125:45041
I20260811 19:02:18.728499 19222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.125:45041 every 8 connection(s)
I20260811 19:02:18.728793 19102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/data/info.pb
I20260811 19:02:18.729753 19224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:18.731220 19224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:02:18.732777 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 19102
I20260811 19:02:18.732892 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-1/wal/instance
I20260811 19:02:18.733076 6025 external_mini_cluster.cc:1428] Setting key 33aaf6c4a254046b0456490ffc66316e
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.125@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:02:18.739605 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.731824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52598 (local address 127.5.226.126:36811)
0811 19:02:18.731874 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.731876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.732050 (+ 174us) server_negotiation.cc:407] Connection header received
0811 19:02:18.732522 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.732524 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.732540 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.732589 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.733225 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.733763 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.734706 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.734920 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.734975 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.737098 (+ 2123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.737100 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.737100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.737108 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.738391 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.738747 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.738748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.738748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.738805 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.739020 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.739021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.739021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.739129 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.739184 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.739436 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.739518 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 19:02:18.739753 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.731793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:36811 (local address 127.0.0.1:52598)
0811 19:02:18.731940 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.731976 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:18.732426 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:18.732657 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:18.732662 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:18.732927 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:18.733132 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.733138 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.733847 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.733848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.734625 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.734628 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.735010 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.735012 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.735119 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.735565 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:18.735573 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:18.737012 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:18.738465 (+ 1453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.738472 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.738474 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.738681 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.738865 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.738865 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.738866 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.738965 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.739182 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:18.739189 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:18.739320 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 19:02:18.739408 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 19:02:18.739551 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
I20260811 19:02:18.740217 19224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.5.226.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.226.124@KRBTEST.COM" created.
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.125@KRBTEST.COM for kudu/127.5.226.125@KRBTEST.COM
I20260811 19:02:18.747022 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.740445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45041 (local address 127.0.0.1:41170)
0811 19:02:18.740485 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.740494 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:18.740528 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:18.740742 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:18.740743 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:18.740869 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:18.740911 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.740912 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.741774 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.741774 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.742292 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.742294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.742715 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.742716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.742774 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.743086 (+ 312us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:18.743091 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:18.744388 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:18.746001 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.746002 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.746003 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.746208 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.746391 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.746392 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.746392 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.746456 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.746682 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:18.746683 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:18.746734 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 19:02:18.746809 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 19:02:18.746904 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 19:02:18.747047 19237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.740498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41170 (local address 127.5.226.125:45041)
0811 19:02:18.740631 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.740635 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.740647 (+ 12us) server_negotiation.cc:407] Connection header received
0811 19:02:18.740662 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.740663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.740673 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.740731 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.740973 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.741696 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.742366 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.742655 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.742710 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.744466 (+ 1756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.744475 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.744475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.744483 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.745923 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.746278 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.746280 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.746281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.746328 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.746507 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.746508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.746508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.746623 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.746678 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.746831 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.746957 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260811 19:02:18.747686 19224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:02:18.748016 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.747898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:37895 (local address 127.0.0.1:33988)
0811 19:02:18.747943 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.747995 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 19:02:18.748152 19135 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
I20260811 19:02:18.748565 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.748464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:37895 (local address 127.0.0.1:33990)
0811 19:02:18.748512 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.748543 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 19:02:18.748667 19224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:37895: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.226.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.124.keytab.
Entry for principal kudu/127.5.226.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.124.keytab.
I20260811 19:02:18.758335 6025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskptszHt/build/release/bin/kudu
/tmp/dist-test-taskptszHt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.124:37895
--webserver_interface=127.5.226.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.124.keytab
--principal=kudu/127.5.226.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.226.84:46845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.226.126:36811,127.5.226.125:45041,127.5.226.124:37895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:02:18.797899 19224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } attempt: 1
I20260811 19:02:18.798437 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.798274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:37895 (local address 127.0.0.1:34002)
0811 19:02:18.798346 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.798403 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 19:02:18.798779 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.798695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:37895 (local address 127.0.0.1:34010)
0811 19:02:18.798730 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.798757 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 19:02:18.798857 19224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:37895: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
I20260811 19:02:18.811041 19084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } attempt: 3
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for kudu/127.5.226.125@KRBTEST.COM
I20260811 19:02:18.817843 19237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.811417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41174 (local address 127.5.226.125:45041)
0811 19:02:18.811480 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.811482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.811503 (+ 21us) server_negotiation.cc:407] Connection header received
0811 19:02:18.811531 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.811531 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.811540 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.811581 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.811908 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.812452 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.813150 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.813423 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.813481 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.815509 (+ 2028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.815511 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.815511 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.815518 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.816756 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.817120 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.817121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.817121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.817166 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.817364 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.817365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.817365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.817466 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.817513 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.817679 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.817779 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 19:02:18.817857 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.811343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45041 (local address 127.0.0.1:41174)
0811 19:02:18.811406 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.811416 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:18.811463 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:18.811592 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:18.811593 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:18.811749 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:18.811825 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.811827 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.812531 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.812532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.813071 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.813074 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.813488 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.813490 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.813563 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.814011 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:18.814015 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:18.815428 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:18.816833 (+ 1405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.816835 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.816835 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.817055 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.817216 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.817217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.817217 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.817282 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.817532 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:18.817533 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:18.817584 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 19:02:18.817649 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 19:02:18.817758 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 19:02:18.818306 19084 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:02:18.818645 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.818544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:37895 (local address 127.0.0.1:34018)
0811 19:02:18.818588 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.818621 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 19:02:18.818967 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.818886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:37895 (local address 127.0.0.1:34028)
0811 19:02:18.818924 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.818949 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 19:02:18.819058 19084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:37895: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
W20260811 19:02:18.842315 19241 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 19:02:18.842494 19241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:02:18.842510 19241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:02:18.842527 19241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:02:18.843616 19241 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:02:18.843655 19241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:02:18.843668 19241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:02:18.843693 19241 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:02:18.843714 19241 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:02:18.845153 19241 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.226.84:46845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.5.226.126:36811,127.5.226.125:45041,127.5.226.124:37895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/krb5kdc/kudu_127.5.226.124.keytab
--principal=kudu/127.5.226.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.226.124:37895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.226.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 19:02:18.845398 19241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:02:18.845611 19241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:02:18.850098 19247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:18.850226 19241 server_base.cc:1034] running on GCE node
W20260811 19:02:18.850131 19252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:18.850214 19084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } attempt: 1
W20260811 19:02:18.850131 19246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:02:18.850590 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.850475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:37895 (local address 127.0.0.1:34044)
0811 19:02:18.850522 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.850558 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 19:02:18.850646 19241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:02:18.850970 19241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:02:18.851032 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.850934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:37895 (local address 127.0.0.1:34058)
0811 19:02:18.850978 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.851004 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 19:02:18.851125 19084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:37895: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
I20260811 19:02:18.852126 19241 hybrid_clock.cc:648] HybridClock initialized: now 1786474938852111 us; error 27 us; skew 500 ppm
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:02:18.854508 19241 init.cc:377] Logged in from keytab as kudu/127.5.226.124@KRBTEST.COM (short username kudu)
I20260811 19:02:18.854907 19241 webserver.cc:460] Webserver started at http://127.5.226.124:39039/ using document root <none> and password file <none>
I20260811 19:02:18.855098 19241 fs_manager.cc:359] Metadata directory not provided
I20260811 19:02:18.855134 19241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:02:18.855225 19241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:02:18.856185 19241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/data/instance:
uuid: "1602699e09704d06972ab6ebf09d7468"
format_stamp: "Formatted at 2026-08-11 19:02:18 on dist-test-slave-gjw7"
server_key: "1a1a41e342ea6adfe30784787825b8ce"
server_key_iv: "a6493fb2d01568b45b902507051ff257"
server_key_version: "encryptionkey@0"
I20260811 19:02:18.856474 19241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/wal/instance:
uuid: "1602699e09704d06972ab6ebf09d7468"
format_stamp: "Formatted at 2026-08-11 19:02:18 on dist-test-slave-gjw7"
server_key: "1a1a41e342ea6adfe30784787825b8ce"
server_key_iv: "a6493fb2d01568b45b902507051ff257"
server_key_version: "encryptionkey@0"
I20260811 19:02:18.857652 19241 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 19:02:18.858263 19274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:02:18.858412 19241 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 19:02:18.858489 19241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/data,/tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/wal
uuid: "1602699e09704d06972ab6ebf09d7468"
format_stamp: "Formatted at 2026-08-11 19:02:18 on dist-test-slave-gjw7"
server_key: "1a1a41e342ea6adfe30784787825b8ce"
server_key_iv: "a6493fb2d01568b45b902507051ff257"
server_key_version: "encryptionkey@0"
I20260811 19:02:18.858552 19241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:02:18.866981 19224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } attempt: 2
I20260811 19:02:18.867357 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.867223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:37895 (local address 127.0.0.1:34064)
0811 19:02:18.867283 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.867322 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 19:02:18.867678 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.867590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:37895 (local address 127.0.0.1:34074)
0811 19:02:18.867629 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.867655 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 19:02:18.867758 19224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.226.124:37895: Network error: Client connection negotiation failed: client connection to 127.5.226.124:37895: connect: Connection refused (error 111)
I20260811 19:02:18.868538 19241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:02:18.870589 19241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:02:18.870723 19241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:02:18.874449 19241 rpc_server.cc:307] RPC server started. Bound to: 127.5.226.124:37895
I20260811 19:02:18.874478 19369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.226.124:37895 every 8 connection(s)
I20260811 19:02:18.874790 19241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/data/info.pb
I20260811 19:02:18.875743 19370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:02:18.877215 19370 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.124@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:02:18.883097 6025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskptszHt/build/release/bin/kudu as pid 19241
I20260811 19:02:18.883215 6025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskptszHt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474660766540-6025-0/minicluster-data/master-2/wal/instance
I20260811 19:02:18.883427 6025 external_mini_cluster.cc:1428] Setting key 30306bc968c040f5c92dae52520f92e4
I20260811 19:02:18.885690 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.877882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52614 (local address 127.5.226.126:36811)
0811 19:02:18.877924 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.877926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.878106 (+ 180us) server_negotiation.cc:407] Connection header received
0811 19:02:18.878605 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.878607 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.878620 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.878665 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.879266 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.879738 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.880684 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.880871 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.880926 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.882868 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.882870 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.882870 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.882877 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.884442 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.884810 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.884811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.884811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.884866 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.885110 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.885111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.885111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.885207 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.885249 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.885565 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.885627 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 19:02:18.885892 19382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.877840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.126:36811 (local address 127.0.0.1:52614)
0811 19:02:18.877997 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.878030 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:18.878509 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:18.878744 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:18.878748 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:18.878989 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:18.879177 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.879181 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.879816 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.879817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.880599 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.880602 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.880961 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.880963 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.881070 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.881517 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:18.881525 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:18.882779 (+ 1254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:18.884513 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.884518 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.884520 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.884734 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.884918 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.884919 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.884919 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.885049 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.885253 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:18.885257 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:18.885434 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 19:02:18.885540 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 19:02:18.885684 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
I20260811 19:02:18.886445 19370 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.124@KRBTEST.COM
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.124@KRBTEST.COM for kudu/127.5.226.125@KRBTEST.COM
I20260811 19:02:18.891840 19387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.883787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34088 (local address 127.5.226.124:37895)
0811 19:02:18.883942 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.883947 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.883994 (+ 47us) server_negotiation.cc:407] Connection header received
0811 19:02:18.884063 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.884064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.884075 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.884135 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.884760 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.885761 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.886802 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.887089 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.887142 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.889353 (+ 2211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.889367 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.889367 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.889374 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.890733 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.891086 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.891089 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.891089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.891153 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.891336 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.891336 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.891337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.891470 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.891573 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.891679 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.891744 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":82,"threads_started":1}
I20260811 19:02:18.892791 19382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.886682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.125:45041 (local address 127.0.0.1:41176)
0811 19:02:18.886715 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.886724 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:18.886757 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:18.886901 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:18.886902 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:18.887022 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:18.887065 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.887066 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.887787 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.887789 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.888262 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.888263 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.888590 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.888591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.888653 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.888989 (+ 336us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:18.888994 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:18.890231 (+ 1237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:18.891754 (+ 1523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.891755 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.891755 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.891994 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.892201 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.892202 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.892202 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.892259 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.892520 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:18.892521 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:18.892563 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 19:02:18.892627 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 19:02:18.892708 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 19:02:18.892807 19237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.886754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41176 (local address 127.5.226.125:45041)
0811 19:02:18.886796 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.886798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.886805 (+ 7us) server_negotiation.cc:407] Connection header received
0811 19:02:18.886829 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.886829 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.886839 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.886885 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.887137 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.887718 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.888333 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.888536 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.888587 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.890323 (+ 1736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.890325 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.890325 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.890333 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.891682 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.892072 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.892073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.892074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.892138 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.892323 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.892324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.892324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.892460 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.892528 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.892664 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.892745 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 19:02:18.893157 19370 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.124@KRBTEST.COM for kudu/127.5.226.124@KRBTEST.COM
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.126@KRBTEST.COM
I20260811 19:02:18.898880 19382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.893447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:37895 (local address 127.0.0.1:34092)
0811 19:02:18.893473 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.893482 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:18.893514 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:18.893602 (+ 88us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:18.893603 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:18.893720 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:18.893742 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.893744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.894294 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.894295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.894738 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.894739 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.895057 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.895058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.895101 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.895505 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:18.895509 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:18.896536 (+ 1027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:18.898042 (+ 1506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.898044 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.898044 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.898202 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.898384 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.898384 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.898385 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.898427 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.898629 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:18.898629 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:18.898659 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 19:02:18.898712 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 19:02:18.898798 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12}
I20260811 19:02:18.898959 19387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.893497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34092 (local address 127.5.226.124:37895)
0811 19:02:18.893529 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.893530 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.893537 (+ 7us) server_negotiation.cc:407] Connection header received
0811 19:02:18.893552 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.893552 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.893560 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.893601 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.893800 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.894233 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.894798 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.895004 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.895054 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.896613 (+ 1559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.896614 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.896615 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.896621 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.897956 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.898261 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.898262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.898262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.898316 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.898464 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.898465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.898465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.898580 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.898638 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.898751 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.898868 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":18}
I20260811 19:02:18.899740 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.892919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52622 (local address 127.5.226.126:36811)
0811 19:02:18.892979 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.892981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.892988 (+ 7us) server_negotiation.cc:407] Connection header received
0811 19:02:18.893009 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.893010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.893020 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.893070 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.893633 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.894087 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.894708 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.894909 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.894961 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.897332 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.897333 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.897334 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.897341 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.898638 (+ 1297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.898915 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.898916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.898917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.898976 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.899263 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.899264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.899265 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.899416 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.899535 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.899625 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.899683 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 19:02:18.900563 19370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468: Bootstrap starting.
I20260811 19:02:18.901537 19370 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:18.901852 19370 log.cc:824] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:18.902619 19370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468: No bootstrap required, opened a new log
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.226.125@KRBTEST.COM
I20260811 19:02:18.904516 19370 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } }
I20260811 19:02:18.904647 19370 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1602699e09704d06972ab6ebf09d7468, State: Initialized, Role: FOLLOWER
I20260811 19:02:18.904733 19370 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } }
I20260811 19:02:18.905066 19370 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:02:18.905014 19396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } } }
I20260811 19:02:18.905128 19396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 19:02:18.906922 19418 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:02:18.906976 19418 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:02:18.907769 19237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.900345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41182 (local address 127.5.226.125:45041)
0811 19:02:18.900383 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.900385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.900394 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:02:18.900433 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.900433 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.900442 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.900500 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.900924 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.901602 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.902419 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.902608 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.902661 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.904757 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.904759 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.904759 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.904766 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.906368 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.906867 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.906868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.906868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.906931 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.907134 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.907135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.907136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.907254 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.907391 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.907607 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.907684 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 19:02:18.907233 19241 master_runner.cc:186] Error getting master registration for 127.5.226.126:36811: OK, instance_id { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" instance_seqno: 1786474938585812 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 19:02:18.909224 19241 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 19:02:18.909255 6025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:02:18.910405 19032 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "51eaa019823a47eb87e84ea1f3fce688"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52622
I20260811 19:02:18.926222 19084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } attempt: 2
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.126@KRBTEST.COM for kudu/127.5.226.124@KRBTEST.COM
I20260811 19:02:18.932245 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.926551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:37895 (local address 127.0.0.1:34096)
0811 19:02:18.926617 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.926629 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:18.926684 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:18.926827 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:18.926827 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:18.926981 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:18.927023 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.927024 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.927603 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.927604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.928103 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.928104 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.928420 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.928421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.928477 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.928857 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:18.928862 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:18.929988 (+ 1126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:18.931324 (+ 1336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.931325 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.931325 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.931487 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.931648 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.931648 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.931649 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.931707 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.931948 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:18.931949 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:18.931995 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 19:02:18.932055 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 19:02:18.932151 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 19:02:18.932245 19387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.926635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34096 (local address 127.5.226.124:37895)
0811 19:02:18.926676 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.926678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.926687 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:02:18.926744 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.926745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.926755 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.926802 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.927088 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.927539 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.928172 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.928362 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.928417 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.930066 (+ 1649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.930067 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.930068 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.930075 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.931250 (+ 1175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.931547 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.931548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.931549 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.931595 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.931755 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.931756 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.931756 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.931887 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.931943 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.932082 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.932151 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 19:02:18.933739 19084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688: Bootstrap starting.
I20260811 19:02:18.934466 19084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:18.934757 19084 log.cc:824] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:18.935619 19084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688: No bootstrap required, opened a new log
I20260811 19:02:18.936939 19084 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } }
I20260811 19:02:18.937075 19084 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51eaa019823a47eb87e84ea1f3fce688, State: Initialized, Role: FOLLOWER
I20260811 19:02:18.937146 19084 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } }
I20260811 19:02:18.937479 19084 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:02:18.937429 19425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } } }
I20260811 19:02:18.937533 19032 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 19:02:18.937597 19425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:02:18.937654 19032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:18.938452 19032 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } }
I20260811 19:02:18.939158 19032 leader_election.cc:288] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [CANDIDATE]: Term 1 election: Requested vote from peers f7f87134bc0643e4a4d386a82c09eaf8 (127.5.226.125:45041), 1602699e09704d06972ab6ebf09d7468 (127.5.226.124:37895)
W20260811 19:02:18.939404 19452 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:02:18.939508 19452 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:02:18.939429 19328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "51eaa019823a47eb87e84ea1f3fce688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1602699e09704d06972ab6ebf09d7468"
I20260811 19:02:18.939563 19328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:18.940487 19328 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51eaa019823a47eb87e84ea1f3fce688 in term 1.
I20260811 19:02:18.940913 18985 leader_election.cc:302] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1602699e09704d06972ab6ebf09d7468, 51eaa019823a47eb87e84ea1f3fce688; no voters:
I20260811 19:02:18.941028 19425 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:02:18.941159 19425 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [term 1 LEADER]: Becoming Leader. State: Replica: 51eaa019823a47eb87e84ea1f3fce688, State: Running, Role: LEADER
I20260811 19:02:18.941241 19425 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } }
I20260811 19:02:18.941694 19425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51eaa019823a47eb87e84ea1f3fce688. Latest consensus state: current_term: 1 leader_uuid: "51eaa019823a47eb87e84ea1f3fce688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } } }
I20260811 19:02:18.941766 19425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:18.941973 19466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 19:02:18.942135 19466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:02:18.941741 18946 master_runner.cc:186] Error getting master registration for 127.5.226.125:45041: OK, instance_id { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" instance_seqno: 1786474938727451 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 19:02:18.944176 18946 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 19:02:18.945104 19328 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468 [term 1 FOLLOWER]: Refusing update from remote peer 51eaa019823a47eb87e84ea1f3fce688: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:02:18.945602 19463 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:02:18.947058 19396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51eaa019823a47eb87e84ea1f3fce688. Latest consensus state: current_term: 1 leader_uuid: "51eaa019823a47eb87e84ea1f3fce688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } } }
I20260811 19:02:18.947137 19396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:02:18.948732 19469 mvcc.cc:205] Tried to move back new op lower bound from 7317401349916430336 to 7317401349904146432. Current Snapshot: MvccSnapshot[applied={T|T < 7317401349916430336}]
I20260811 19:02:18.948807 19463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "51eaa019823a47eb87e84ea1f3fce688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } } }
I20260811 19:02:18.948892 19463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [sys.catalog]: This master's current role is: LEADER
I20260811 19:02:18.949695 19396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "51eaa019823a47eb87e84ea1f3fce688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } } }
I20260811 19:02:18.949788 19396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:02:18.950992 19466 catalog_manager.cc:1347] Generated new cluster ID: 422e4af92beb4e72a13e97a3754036ca
I20260811 19:02:18.951036 19466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:02:18.950773 19482 mvcc.cc:205] Tried to move back new op lower bound from 7317401349916430336 to 7317401349904146432. Current Snapshot: MvccSnapshot[applied={T|T < 7317401349916430336}]
I20260811 19:02:18.958837 19224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } attempt: 3
I20260811 19:02:18.962280 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.945541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52636 (local address 127.5.226.126:36811)
0811 19:02:18.945583 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.945585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.945743 (+ 158us) server_negotiation.cc:407] Connection header received
0811 19:02:18.945847 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.945848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.945859 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.945888 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.946656 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.947330 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.948303 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.948573 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.948614 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.950603 (+ 1989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.950605 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.950605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.950612 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.958497 (+ 7885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.960822 (+ 2325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.960823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.960824 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.960884 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.961675 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.961676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.961676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.961814 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.961901 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.962114 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.962192 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 19:02:18.963290 19237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.945925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41184 (local address 127.5.226.125:45041)
0811 19:02:18.946018 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.946020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.953457 (+ 7437us) server_negotiation.cc:407] Connection header received
0811 19:02:18.953560 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.953562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.953574 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.953626 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.954248 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.954946 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.956544 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.956865 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.956899 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.959553 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.959554 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.959554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.959575 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.961301 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.961970 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.961971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.961971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.962026 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.962325 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.962326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.962327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.962481 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.962562 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.963133 (+ 571us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.963206 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 19:02:18.967706 19466 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:02:18.968430 19466 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:02:18.974236 19387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.946119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34108 (local address 127.5.226.124:37895)
0811 19:02:18.946155 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.946157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.953633 (+ 7476us) server_negotiation.cc:407] Connection header received
0811 19:02:18.954332 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.954333 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.954344 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.954383 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.954937 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.955659 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.969397 (+ 13738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.969696 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.969759 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.971225 (+ 1466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.971226 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.971226 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.971233 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.972786 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.973171 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.973173 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.973173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.973232 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.973467 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.973468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.973469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.973594 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.973688 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.974067 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.974142 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 19:02:18.975461 19466 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688: Generated new TSK 0
Aug 11 19:02:18 dist-test-slave-gjw7 krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474938, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.226.125@KRBTEST.COM for kudu/127.5.226.124@KRBTEST.COM
I20260811 19:02:18.975800 19466 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 19:02:18.979257 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.959087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.226.124:37895 (local address 127.0.0.1:34110)
0811 19:02:18.959173 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 19:02:18.959182 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 19:02:18.959217 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:02:18.966974 (+ 7757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:02:18.966975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:02:18.967131 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:02:18.967178 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.967180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.973015 (+ 5835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.973017 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.973725 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:02:18.973729 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.974167 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.974168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:02:18.974230 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.974674 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:02:18.974679 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:02:18.976263 (+ 1584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:02:18.978227 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.978228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.978228 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.978454 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.978658 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:02:18.978659 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:02:18.978659 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:02:18.978714 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:02:18.978964 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:02:18.978965 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:02:18.979008 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 19:02:18.979063 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 19:02:18.979161 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 19:02:18.979265 19490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:18.959309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34110 (local address 127.5.226.124:37895)
0811 19:02:18.966825 (+ 7516us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:18.966827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:18.966835 (+ 8us) server_negotiation.cc:407] Connection header received
0811 19:02:18.966853 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:18.966854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:18.966866 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:18.967246 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:18.967295 (+ 49us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.972938 (+ 5643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.973804 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:18.974104 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:18.974159 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:18.976366 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:02:18.976367 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:02:18.976368 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:02:18.976374 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:02:18.978111 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.978519 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.978521 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.978521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.978595 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:02:18.978759 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:02:18.978760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:02:18.978760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:02:18.978899 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:02:18.978947 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:18.979095 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 19:02:18.979162 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7014,"thread_start_us":98,"threads_started":1}
I20260811 19:02:18.982460 19224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8: Bootstrap starting.
I20260811 19:02:18.983163 19224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8: Neither blocks nor log segments found. Creating new log.
I20260811 19:02:18.983449 19224 log.cc:824] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8: Log is configured to *not* fsync() on all Append() calls
I20260811 19:02:18.984369 19224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8: No bootstrap required, opened a new log
I20260811 19:02:18.986388 19224 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } }
I20260811 19:02:18.986536 19224 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7f87134bc0643e4a4d386a82c09eaf8, State: Initialized, Role: FOLLOWER
I20260811 19:02:18.986614 19224 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } }
I20260811 19:02:18.986932 19224 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:02:18.988323 19178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:02:18.988184 19179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "51eaa019823a47eb87e84ea1f3fce688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f7f87134bc0643e4a4d386a82c09eaf8"
I20260811 19:02:18.989176 19178 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8 [term 1 FOLLOWER]: Refusing update from remote peer 51eaa019823a47eb87e84ea1f3fce688: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:02:18.989962 19463 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:02:18.990029 19179 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51eaa019823a47eb87e84ea1f3fce688 in term 1.
W20260811 19:02:18.991274 19520 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:02:18.991325 19520 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:02:18.991488 19501 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } } }
I20260811 19:02:18.991565 19501 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:02:18.997376 19527 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "51eaa019823a47eb87e84ea1f3fce688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } } }
I20260811 19:02:18.997489 19527 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:02:19.001575 19501 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51eaa019823a47eb87e84ea1f3fce688. Latest consensus state: current_term: 1 leader_uuid: "51eaa019823a47eb87e84ea1f3fce688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } } }
I20260811 19:02:19.001662 19501 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 19:02:19.001950 19490 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:19.000496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34118 (local address 127.5.226.124:37895)
0811 19:02:19.000535 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:19.000537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:19.001186 (+ 649us) server_negotiation.cc:407] Connection header received
0811 19:02:19.001311 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:19.001312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:19.001326 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:19.001368 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:19.001888 (+ 520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34118: BlockingRecv error: recv got EOF from 127.0.0.1:34118 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 19:02:19.002727 19237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:19.000912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41198 (local address 127.5.226.125:45041)
0811 19:02:19.000947 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:19.000949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:19.002253 (+ 1304us) server_negotiation.cc:407] Connection header received
0811 19:02:19.002345 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:19.002346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:19.002367 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:19.002395 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:19.002677 (+ 282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41198: BlockingRecv error: recv got EOF from 127.0.0.1:41198 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 19:02:19.003798 19091 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:19.003154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52650 (local address 127.5.226.126:36811)
0811 19:02:19.003200 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:19.003202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:19.003311 (+ 109us) server_negotiation.cc:407] Connection header received
0811 19:02:19.003413 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:19.003414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:19.003426 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:19.003452 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:19.003738 (+ 286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52650: BlockingRecv error: recv got EOF from 127.0.0.1:52650 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 19:02:19.005638 19525 mvcc.cc:205] Tried to move back new op lower bound from 7317401350033457152 to 7317401349904146432. Current Snapshot: MvccSnapshot[applied={T|T < 7317401349916430336}]
W20260811 19:02:19.010119 19237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:19.009506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41210 (local address 127.5.226.125:45041)
0811 19:02:19.009540 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:19.009542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:19.009635 (+ 93us) server_negotiation.cc:407] Connection header received
0811 19:02:19.009732 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:19.009733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:19.009749 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:19.009776 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:19.010077 (+ 301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41210: BlockingRecv error: recv got EOF from 127.0.0.1:41210 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 19:02:19.016109 19237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:19.015342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41226 (local address 127.5.226.125:45041)
0811 19:02:19.015387 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:19.015388 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:19.015619 (+ 231us) server_negotiation.cc:407] Connection header received
0811 19:02:19.015709 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:19.015710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:19.015720 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:19.015747 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:19.016066 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41226: BlockingRecv error: recv got EOF from 127.0.0.1:41226 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 19:02:19.019996 19237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:19.019292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41234 (local address 127.5.226.125:45041)
0811 19:02:19.019322 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:19.019324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:19.019543 (+ 219us) server_negotiation.cc:407] Connection header received
0811 19:02:19.019632 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:19.019633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:19.019643 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:19.019669 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:19.019955 (+ 286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41234: BlockingRecv error: recv got EOF from 127.0.0.1:41234 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260811 19:02:19.025903 19237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:19.025140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41236 (local address 127.5.226.125:45041)
0811 19:02:19.025179 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:19.025181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:19.025436 (+ 255us) server_negotiation.cc:407] Connection header received
0811 19:02:19.025526 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:19.025527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:19.025542 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:19.025572 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:19.025862 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41236: BlockingRecv error: recv got EOF from 127.0.0.1:41236 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 19:02:19.035938 19237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:19.035119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41244 (local address 127.5.226.125:45041)
0811 19:02:19.035176 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:19.035178 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:19.035407 (+ 229us) server_negotiation.cc:407] Connection header received
0811 19:02:19.035517 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:19.035518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:19.035528 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:19.035554 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:19.035873 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41244: BlockingRecv error: recv got EOF from 127.0.0.1:41244 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 19:02:19.054329 19237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:19.053367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41248 (local address 127.5.226.125:45041)
0811 19:02:19.053416 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:19.053418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:19.053713 (+ 295us) server_negotiation.cc:407] Connection header received
0811 19:02:19.053826 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:19.053827 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:19.053840 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:19.053869 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:19.054273 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41248: BlockingRecv error: recv got EOF from 127.0.0.1:41248 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 19:02:19.088929 19237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:19.087945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41264 (local address 127.5.226.125:45041)
0811 19:02:19.087996 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:19.087998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:19.088302 (+ 304us) server_negotiation.cc:407] Connection header received
0811 19:02:19.088408 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:19.088409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:19.088421 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:19.088459 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:19.088867 (+ 408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41264: BlockingRecv error: recv got EOF from 127.0.0.1:41264 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 19:02:19.155136 19237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:19.154470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41268 (local address 127.5.226.125:45041)
0811 19:02:19.154542 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:19.154544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:19.154611 (+ 67us) server_negotiation.cc:407] Connection header received
0811 19:02:19.154684 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:19.154685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:19.154698 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:19.154743 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:19.155070 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41268: BlockingRecv error: recv got EOF from 127.0.0.1:41268 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260811 19:02:19.284878 19237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:19.284252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41280 (local address 127.5.226.125:45041)
0811 19:02:19.284317 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:19.284319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:19.284402 (+ 83us) server_negotiation.cc:407] Connection header received
0811 19:02:19.284456 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:19.284457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:19.284467 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:19.284530 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:19.284818 (+ 288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41280: BlockingRecv error: recv got EOF from 127.0.0.1:41280 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 19:02:19.400245 19463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "51eaa019823a47eb87e84ea1f3fce688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51eaa019823a47eb87e84ea1f3fce688" member_type: VOTER last_known_addr { host: "127.5.226.126" port: 36811 } } peers { permanent_uuid: "f7f87134bc0643e4a4d386a82c09eaf8" member_type: VOTER last_known_addr { host: "127.5.226.125" port: 45041 } } peers { permanent_uuid: "1602699e09704d06972ab6ebf09d7468" member_type: VOTER last_known_addr { host: "127.5.226.124" port: 37895 } } }
I20260811 19:02:19.400408 19463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51eaa019823a47eb87e84ea1f3fce688 [sys.catalog]: This master's current role is: LEADER
W20260811 19:02:19.542930 19237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:02:19.542273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41284 (local address 127.5.226.125:45041)
0811 19:02:19.542331 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:19.542333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:19.542383 (+ 50us) server_negotiation.cc:407] Connection header received
0811 19:02:19.542448 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:19.542449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:19.542460 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:19.542521 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:02:19.542869 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41284: BlockingRecv error: recv got EOF from 127.0.0.1:41284 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 19:02:19.907387 19418 catalog_manager.cc:1259] Loaded cluster ID: 422e4af92beb4e72a13e97a3754036ca
I20260811 19:02:19.907451 19418 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468: loading cluster ID for follower catalog manager: success
I20260811 19:02:19.908232 19418 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468: acquiring CA information for follower catalog manager: success
I20260811 19:02:19.908538 19418 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1602699e09704d06972ab6ebf09d7468: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 19:02:19.991737 19520 catalog_manager.cc:1259] Loaded cluster ID: 422e4af92beb4e72a13e97a3754036ca
I20260811 19:02:19.991816 19520 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8: loading cluster ID for follower catalog manager: success
I20260811 19:02:19.992614 19520 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8: acquiring CA information for follower catalog manager: success
I20260811 19:02:19.992916 19520 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f7f87134bc0643e4a4d386a82c09eaf8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 19:02:20.058862 19655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:20.056133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60328 (local address 127.5.226.125:45041)
0811 19:02:20.056255 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:20.056257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:20.056272 (+ 15us) server_negotiation.cc:407] Connection header received
0811 19:02:20.056376 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:20.056378 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:20.056443 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:20.056513 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:02:20.056664 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:20.057173 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:20.058070 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:20.058291 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:20.058350 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:20.058518 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:02:20.058636 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:02:20.058713 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:20.058750 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 19:02:20.058774 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":62,"threads_started":1}
I20260811 19:02:20.062904 19666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:20.060545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45062 (local address 127.5.226.124:37895)
0811 19:02:20.060650 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:20.060652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:20.060677 (+ 25us) server_negotiation.cc:407] Connection header received
0811 19:02:20.060759 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:20.060760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:20.060799 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:20.060865 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:02:20.060976 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:20.061506 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:20.062204 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:20.062395 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:20.062447 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:20.062586 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:02:20.062691 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:02:20.062753 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:20.062799 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 19:02:20.062822 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":51,"threads_started":1}
I20260811 19:02:20.066885 19666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:20.064456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45076 (local address 127.5.226.124:37895)
0811 19:02:20.064514 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:20.064516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:20.064654 (+ 138us) server_negotiation.cc:407] Connection header received
0811 19:02:20.064734 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:20.064735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:20.064745 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:20.064791 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:02:20.064927 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:20.065453 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:20.066286 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:20.066466 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:20.066514 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:20.066659 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:02:20.066689 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:02:20.066730 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:20.066786 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 19:02:20.066805 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 19:02:20.067436 19655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:20.064412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60330 (local address 127.5.226.125:45041)
0811 19:02:20.064449 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:20.064451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:20.064616 (+ 165us) server_negotiation.cc:407] Connection header received
0811 19:02:20.064836 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:20.064838 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:20.064850 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:20.064894 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:02:20.065065 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:20.065798 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:20.066640 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:20.066915 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:20.066972 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:20.067140 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:02:20.067169 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:02:20.067194 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:20.067358 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 19:02:20.067381 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 19:02:20.068305 19681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:02:20.064427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58308 (local address 127.5.226.126:36811)
0811 19:02:20.064662 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 19:02:20.064664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 19:02:20.064673 (+ 9us) server_negotiation.cc:407] Connection header received
0811 19:02:20.064774 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:02:20.064775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:02:20.064811 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:02:20.064885 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:02:20.065013 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:20.065801 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:20.067474 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:02:20.067758 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:02:20.067821 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:02:20.068020 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:02:20.068102 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:02:20.068152 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 19:02:20.068200 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 19:02:20.068227 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":49,"threads_started":1}
I20260811 19:02:20.072996 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 18946
I20260811 19:02:20.084241 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 19102
I20260811 19:02:20.099650 6025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskptszHt/build/release/bin/kudu with pid 19241
2026-08-11T19:02:20Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3008 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6035 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (279333 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST